172
1 Review of Therapies - Part 1 A REVIEW OF THERAPIES FOR ATTENTION- DEFICIT/HYPERACTIVITY DISORDER Anton Miller, MB.ChB., FRCPC 1, 3 Shoo K. Lee, MB.BS., Ph.D., FRCPC 2,3 Parminder Raina, Ph.D. 1,4 Anne Klassen, D.Phil. 5 John Zupancic, MD, FRCPC 5 Lise Olsen, BSN, MPH 6 1 Faculty, Centre for Community Child Health Research, B.C. Research Institute for Children=s and Women=s Health 2 Faculty, Centre for Evaluation Sciences, B.C. Research Institute for Children's and Women=s Health 3 Department of Pediatrics, University of British Columbia 4 Department of Health Care & Epidemiology, University of British Columbia 5 Affiliate, Centre for Evaluation Sciences 6 Research Associate, Centre for Community Child Health Research Part 1: Overview and Clinical Evaluation of the Use of Methylphenidate for Attention-Deficit/Hyperactivity Disorder Part 2: The Efficacy of Medical and Other Therapies for Attention- Deficit/Hyperactivity Disorder in Children and Youth: a Systematic Review and Meta-analysis of the Clinical Evidence Part 3: Economic Evaluation of Pharmaceutical and Psychological/ behavioural Therapies for Attention-Deficit/Hyperactivity Disorder

A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

1Review of Therapies - Part 1

A REVIEW OF THERAPIES FOR ATTENTION-DEFICIT/HYPERACTIVITY DISORDER

Anton Miller, MB.ChB., FRCPC 1, 3

Shoo K. Lee, MB.BS., Ph.D., FRCPC 2,3

Parminder Raina, Ph.D. 1,4

Anne Klassen, D.Phil. 5

John Zupancic, MD, FRCPC 5

Lise Olsen, BSN, MPH 6

1 Faculty, Centre for Community Child Health Research, B.C. Research Institute for Children=sand Women=s Health

2 Faculty, Centre for Evaluation Sciences, B.C. Research Institute for Children's and Women=sHealth

3 Department of Pediatrics, University of British Columbia4 Department of Health Care & Epidemiology, University of British Columbia5 Affiliate, Centre for Evaluation Sciences6 Research Associate, Centre for Community Child Health Research

Part 1: Overview and Clinical Evaluation of the Use of Methylphenidate forAttention-Deficit/Hyperactivity Disorder

Part 2: The Efficacy of Medical and Other Therapies for Attention-Deficit/Hyperactivity Disorder in Children and Youth: a SystematicReview and Meta-analysis of the Clinical Evidence

Part 3: Economic Evaluation of Pharmaceutical and Psychological/behavioural Therapies for Attention-Deficit/Hyperactivity Disorder

Page 2: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

2Review of Therapies - Part 1

Project Overview

This is a report to the Canadian Coordinating Office of Health Technology Assessment whichsummarizes work completed between August 1997 and July 1998, funded by CCOHTA underRFP #ADHD-1196. The broad objectives were to (1) critically evaluate the clinical evidenceregarding certain aspects of the use of methylphenidate in attention-deficit/hyperactivity disorder(ADHD) in pre-schoolers, school-aged children, adolescents and adults and (2) to conduct asystematic review of efficacy and an economic evaluation of the cost-effectiveness ofmethylphenidate, other stimulant drugs, and non-drug (psychological/behavioral) treatments forADHD in children and youth.

One of the primary motivations underlying this request for evaluation was concern on the part ofdrug managers related to the increasing utilization of methylphenidate in both children and adultsand the potential for abuse or illicit use of this drug. Concerns included whether the medication isprescribed appropriately from both a therapeutic and economic perspective, and the effectivenessof other modalities of therapy. We decided to structure this report as a three-part Amodular@series with each section addressing a particular need or set of concerns.

Part 1, >Overview and Clinical Evaluation of the Use of Methylphenidate for Attention-Deficit/Hyperactivity Disorder= represents a comprehensive, synthetic and innovative review ofpublished information and unpublished data to deal with the questions of utilization, efficacy,abuse/illicit use and appropriateness of prescription of methylphenidate. In it we:(1) document marked upward trends in prescription of methylphenidate in Canada and find that

the increasing prevalence of use is largely (though not entirely) related to increasedprescription to children and youth. Possible reasons for these increases are discussed;

(2) describe the robust body of evidence for the efficacy of methylphenidate in ameliorating thebehavioural problems of children and adolescents with ADHD in short-term studies. We alsonote, however, that its efficacy with pre-schoolers and adults is less clearly established, andthat evidence of long-term effectiveness of stimulant therapy remains lacking;

(3) find that abuse/illicit use of stimulant drugs appears to be limited, at least in relation to otherdrugs. However, data on methylphenidate specifically, and data from the last few years, arelacking. We acknowledge that the potential exists for significant abuse/illicit use; and finally

(4) we conclude on the basis of a qualitative analysis of indirect evidence from various sourcesthat management of ADHD is likely to be suboptimal in at least a sizeable minority of cases,and that in some of these cases, methylphenidate will likely have been prescribedinappropriately. We recognize, however, the difficulties in evaluating Aappropriateness@ in adomain where a fundamental role for individual clinical judgment is widely acknowledged, andwhere the political and economic realities of service delivery in the education and health caresectors militate against optimal care for children with developmental and behavioral disorders. We also recognize the need to place the question of appropriateness within the context ofcurrent North American social-cultural attitudes and pressures.

Page 3: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

3Review of Therapies - Part 1

Part 2, >The Efficacy of Medical and Other Therapies for ADHD in Children and Youth: ASystematic Review and Meta-analysis of the Clinical Evidence= involves a systematic search forand evaluation and meta-analysis of data to address the relative efficacy of the stimulant drugs(individually and collectively), psychological/behavioural therapies, and combinations of drugs andpsychological/behavioural therapies. An important purpose of this process was to deriveestimates of efficacy that could be incorporated into the subsequent cost-effectiveness analysis. Interms of improvements as teacher and parent ratings of behaviours that are likely to bring a childwith ADHD to clinical attention, the stimulant drugs were consistently efficacious and no cleardifferences were detected between methylphenidate, dextroamphetamine and pemoline. The effectsizes (weighted mean difference)(WMD) found on the Conner Teacher Rating Scale for individualdrugs vs. placebo were as follows: methylphenidate (8 studies, 421 subjects) WMD = - 6.73,95% CI = - 7.57, - 5.89; dextroamphetamine (4 studies, 61 subjects) WMD = - 4.71, 95% CI = -6.43, - 2.99; pemoline high dose (1 study, 28 subjects)WMD = - 7.8, 95% CI = - 11.2, - 4.36); pemoline low dose (1 study, 28 subjects) WMD = - 4.0,95%, CI = - 7.8, - 0.2. Psychological/ behavioural therapies were not consistently efficacious. Combinations of medications with psychological/behavioural therapies were no more efficaciousthan drug therapy alone, and showed an inconsistent pattern of efficacy when contrasted with notherapy/placebo or with psychological/behavioural therapies alone. A very cautious interpretationof these findings is advised, however, because serious methodological difficulties inherent in thetreatment literature on ADHD necessitated a number of decisions to be taken regarding the designof our study that potentially compromise internal validity and external generalizability.

Part 3 > Economic Evaluation of Medical and Psychological/Behavioural Therapies forADHD= used the estimates of efficacy derived from Part 2 and costs from published sources andexpert panels in a decision analytic model to analyze incremental cost-effectiveness of drugtherapy alone, psychological/behavioural therapy alone, and a combination of these twomodalities. The economic analysis suggests that, when pemoline is excluded from considerationor included at the lower dosage found in the literature, methylphenidate is dominant over both theother pharmaceutical and the non-pharmaceutical or combined options. When pemoline isincluded at the higher dosage found in the literature, it becomes a viable option but has a cost-effectiveness ratio inferior to that of methylphenidate. The conclusions are generally robust inextensive sensitivity analyses. As was the case with Part 2, methodological limitations indicate theneed for extreme caution in interpreting these findings and applying them to policy decisions.

Page 4: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

4Review of Therapies - Part 1

A REVIEW OF THERAPIES FOR ATTENTION DEFICIT/

HYPERACTIVITY DISORDER

Anton Miller, MB.ChB., FRCPCShoo K. Lee, MB.BS., PhD., FRCPC

Parminder Raina, PhD.

Part 1: Overview and Clinical Evaluation of the Use ofMethylphenidate for Attention-Deficit/HyperactivityDisorder

Anton Miller, MB.ChB., FRCPCShoo K. Lee, MB.BS., Ph.D., FRCPC

Parminder Raina, Ph.D.

Page 5: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

5Review of Therapies - Part 1

1. BackgroundMethylphenidate hydrochloride (MPH), widely-known by the trade name Ritalin, is the mostfrequently used modality of treatment for children with attention-deficit/hyperactivity disorder(ADHD). ADHD is a syndromic diagnosis consisting of a combination of four core behaviouralfeatures: developmentally inappropriate levels of inattentiveness to task, distractibility,impulsiveness and motoric overactivity.1,2 It is strongly associated with academicunderachievement, a pattern of conflictual and often unsatisfactory relations with peers, familymembers and teachers, and low self-esteem. These associated features probably account for muchof the morbidity of the condition. In spite of the fact that ADHD is the most frequently diagnosedbehaviour disorder in North American children3 and the most abundantly researched entity in childpsychiatry, controversies continue about the definitional limits of the ADHD syndrome, itsunderlying pathogenesis, and the best ways to manage it.

Given the absence of Aobjective@ biological markers of an underlying neurological disorder andthe fact that the behaviours of a child with ADHD may differ from those of a Anormal@ child onlyin degree or intensity, it is understandable that some have questioned the validity of ADHD as adiagnosis and as a psychiatric disorder.4,5 Critics have also tried to discredit the validity of thisdisorder by pointing to the many changes in conceptualization, categorization and nomenclaturethat have arisen with successive versions of the American Psychiatric Association's Diagnosticand Statistical Manual of Mental Disorders (DSM) which defines (by consensus among experts)diagnostic criteria for the disorder in North America. Adding to the controversy is the fact that inmany countries (European countries, for example) the diagnosis is used only minimally whereas inNorth American studies, it has been estimated that 3 B 5% of school-aged children are diagnosedwith ADHD (DSM- IV).1

The controversies about the existence and definitional limits of ADHD understandably extend toissues of management of children with behaviours characteristic of ADHD. Psychostimulantdrugs have been known for many years to be useful in the management of children withbehavioural disorders including those previously labelled as hyperactive and having minimal braindysfunction,6 many of whom would now be diagnosed with ADHD. More recently, there hasbeen abundant evidence from short-term intervention studies of the clinical efficacy of MPH incontrolling the core symptoms of ADHD and normalizing behaviour.7,8 Benefits have been foundin home, classroom and laboratory contexts and these include reductions in off-task behaviour,motor restlessness and conflictual interactions, improved ability to restrain impulsive respondingand improved performance on a variety of learning and academic tasks. However the dilemma forclinicians and often for parents has been whether and when to use psychoactive drugs withchildren with disordered or difficult-to-manage behaviours.

It has been estimated that between 50% and 90% of children diagnosed with ADHD in the U.S.will be treated with stimulant drugs at some point in time,9,10 of whom 70% will receivemethylphenidate,10 and further that between 2 and 4% of American children between the ages of5 and 14 years are receiving stimulant medication for management of ADHD.9,11 Critics of theuse of medication point to the diagnostic difficulties mentioned above, the potential for as-yetundocumented risks in using psychoactive medication over long periods with children, and thefact that evidence for medium to long term effectiveness of medication remains

Page 6: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

6Review of Therapies - Part 1

undemonstrated.12,13 An argument advanced to explain the discrepancy between short-termefficacy studies and long-term outcome studies is that medication alone cannot be expected to beeffective over the long term for a disorder that pervades many or most aspects of daily functioningand which often co-exists with other conditions predisposing to adverse outcomes such aslearning disabilities, conduct disorders and social disadvantage. A corollary to this argument isthat longer term changes in outcome may perhaps be found when medical therapy is combinedwith other forms of intervention. Whereas short-term efficacy studies have shown that no singlenon-medication intervention when used alone produces superior effects to medical therapy alone,there is some evidence from medium-term follow-up studies that combinations of medical therapywith other modalities (parent counselling and training, behaviour modification approaches, socialskills training and educational interventions) may selectively improve outcome.8,14

Over the past few years concerns have been expressed in the popular media and the medical-scientific community15,16 about the increasing prevalence of MPH prescriptions and about possibleover-diagnosis of ADHD and over-prescription of MPH. There are concerns about the safety ofindividual patients who take the drug (e.g. the possibility of adverse effects), the potential forillicit use and abuse of these drugs, the economic impact of increasing prescriptions and therelative effectiveness and safety of non-drug interventions.

2. ObjectivesThe aim of this section (Part 1) of the report is to evaluate critically the clinical evidenceregarding the use of MPH for ADHD in pre-schoolers, school-aged children, adolescents andadults with reference to four particular areas of concern: (1) trends in utilization (particularly inCanada); (2) efficacy; (3) the extent of abuse/illicit use or risk thereof; and (4) the appropriatenessof prescription of MPH. In subsequent sections we present the results of a systematic review ofthe literature on the efficacy of medical and non-medical modalities of therapy for ADHD and aneconomic evaluation to compare MPH to other stimulants as well as to psychological/behaviouralforms of therapy.

3. MethodologyTo address each of the four areas of concern, we sought to be as systematic and comprehensive aspossible in locating, extracting and synthesizing available data within the constraints imposed bythis section=s being only one of three to be reported, and limited resources. A particular set ofdata needs was drawn up for each question area (AData needs@). The search for data involvedtapping multiple sources as described under the individual question areas below (ASources ofdata@). The available sources were then carefully reviewed and the relevant data extracted andsynthesized, presented as AFindings@. Finally, the findings are critically reviewed and commentedupon in the sections headed AConclusions@.

Page 7: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

7Review of Therapies - Part 1

4. Results4.1 Trends in MPH Utilization4.1.1 Data needs

1. Amount of MPH consumed in Canada in recent years.2. Number of prescriptions for MPH and prescriptees in Canada and its regions in recentyears.3. Number of prescriptions and prescriptees in other western countries in recent years.

4.1.2 Sources of data4.1.2.1 Computerized databasesA search of the English language literature in the Medline (since 1990) and Current Contents(since 1995) electronic databases was conducted using keywords Aattention deficit hyperactivitydisorder@, Amethylphenidate@, Acentral nervous system stimulants@ and related terms cross-referenced against terms that included Aepidemiology@, Aprevalence@ and Autilization@. Relevantarticle titles and abstracts were scrutinized to seek relevant information.

4.1.2.2 HandsearchingA list of Akey@ review articles for handsearching was identified consisting of publications in majorpsychiatric, psychological and pediatric journals, chapters in major psychiatric and pediatrictextbooks and sections of books dealing with ADHD and published since 1995. The list appearsin Appendix 1. These sources were scrutinized and relevant articles were retrieved and reviewed.

4.1.2.3 Other sourcesB.C. Methylphenidate Survey (Miller AR, Armstrong RW, Lalonde CE, unpublished). Theprescription of MPH is regulated in B.C. under the province=s Triplicate Prescription Program.This mandates central notification of all prescriptions of MPH to the B.C. College of Physiciansand Surgeons. We have accessed the Triplicate Prescription Program file to create to create adatabase of the population of recipients of prescriptions of MPH (referred to in the remainder ofthis report as >prescriptees=) in the province of B.C. from 1990 to 1996. The TriplicatePrescription Program database includes a unique personal identifier for each prescriptee andprescribing physician (withheld from the investigators to ensure anonymity of prescriptees andprescribers), the prescriptees postal code and date of birth, and information about the formulationof MPH prescribed, tablet strength, number of tablets, date dispensed and a pharmacy identifier. Linkage procedures were applied to add further data about prescriptees and prescribers. Linkagewas made with files managed by the B.C. Ministry of Health covering background information onall persons enrolled under the Province=s health insurance plan (the Medical Services Plan), aswell as information on payment claims, hospital separations and other indicators of health servicesutilization, files managed by Vital Statistics that include reporting of deaths, and files that containfurther particulars of B.C. physicians. The setup and analysis of this database is a joint venturebetween investigators in the Department of Pediatrics at the University of B.C. (PrincipalInvestigator A. Miller) and the university=s Centre for Health Services and Policy Research.

Intercontinental Medical Statistics (IMS). The Montreal office of this international organizationprovides market research and consultation services to the Canadian pharmaceutical industry.

Page 8: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

8Review of Therapies - Part 1

Using extensive and continuous surveys of pharmacists and prescribing physicians, IMS can be avaluable source of information on current patterns of drug prescription and utilization in Canada. Their >Compuscript= file comprises data reported by a sample of almost 2000 pharmacies designedto be representative of the kinds and distribution of pharmacies across Canada. The sample isstratified by province, store type (chain or independent) and store size (large or small).

4.1.3 FindingsFigure 1 depicts an overall net increase in consumption of MPH in Canada from 1982 B 1996from data supplied by Health Canada. The trend appears irregular over the years, with a largeapparent jump between 1993 and 1994. Consumption is defined as the difference between (Stockon Hand from the previous year plus Imports for the current year) and (stock on Hand at the endof the current year plus Exports for the current year).

Figure 2 depicts a monotonic increase in prescriptions of MPH dispensed from a sample of retailCanadian pharmacies from 1991 B 1996.

Figure 3 depicts regional trends in increased numbers of prescriptions of MPH from the sample ofCanadian pharmacies. All regions show major increases, though the extent varies from 3-to 5-fold net increases between 1992 and 1996.

Figure 4 depicts prescriptions of MPH to persons in B.C. between 1990 and 1996, differentiatingchildren (< 19 years of age) and adults. Figure 5 depicts prescriptions of MPH to children in B.C. 1990 B 1996 by gender and age sub-groups.

Figure 6 depicts the prevalence of MPH use among children in B.C. from 1990 B 1996, in termsof all children receiving a prescription in each year per 1000 children.

Figure 7 depicts the incidence of MPH use among children in B.C. from 1990 B 1996 in terms ofchildren receiving their first-ever prescription (recorded during the six-year study window) per1000 children.

Figure 8 depicts the number of MPH 10 mg tablets prescribed to males in Saskatchewan by agegroup, from 1991 B 1995.

Figure 9 depicts the number of MPH 10 mg tablets prescribed to females in Saskatchewan by agegroup, from 1991 B 1995.

Figure 10 depicts the prevalence of MPH treatment among Baltimore County, U.S. public schoolstudents aged 5 B 17 years, from 1991 B 1995. The prevalence figures are based on a synthesis ofdata from various sources as reported by Safer et al.9

Page 9: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

9Review of Therapies - Part 1

Figure 11 depicts the prevalence of stimulant medication use among males in New South Wales,Australia from 1988 B 1993. The data are derived from information provided by healthdepartments of that state, though the precise method of ascertainment is not reported.

4.1.4 ConclusionsThere are clear upward trends in the consumption and prescription of MPH in Canada in recentyears, with an accelerating trend seen in the period since 1993, roughly. Similar uptrends are seenin the U.S. and Australia. These upward trends are robust in the sense that they are independentof the method used to obtain prevalence figures. The trends seen using IMS=s survey data, whichinvolve sampling of pharmacists, are also apparent in the B.C. MPH Survey which uses databaseanalysis of all prescriptions dispensed in the province and the Saskatchewan data which draw on asimilar source of information.

The prevalence of MPH prescriptions in 1995 in the U.S. (at least in Baltimore County) at about37/1000 appears to be substantially higher than in B.C. at about 11/1000. However, the datasources are not equivalent. The Baltimore figures are for children aged 5-17 years while the B.Cdata are for all children under 19 years of age. Because there are few children under five years onMPH, the prevalence for B.C. would underestimate the number of school-aged children on MPH. However it is doubtful whether this mechanism alone would account for the magnitude of thedifference. It might, on the other hand, account for the slightly higher prevalence of 6 to 12 year-old prescriptees in New South Wales, Australia in 1993 in comparison with B.C.

From B.C. and Saskatchewan data we see that the trend in increased prescription of MPH isaccounted for largely by increased prescription to persons under 19 years of age, i.e. to children.Finally, among children, we see that the group most frequently prescribed for is school-agedchildren, ages 5 to 14 years. Data from the B.C. Methylphenidate Survey shows that adolescents15 to 19 years account for 8.4 % of prescriptees and pre-schoolers under 5 years account for4.6% of prescriptees.

This rising trend has been attributed by some to factors such as increasing use of medication forattention deficit disorder without hyperactivity, reflecting an evolution in the conceptualization ofthis condition, the prolongation of stimulant therapy into the secondary school years, andincreasing use in adults.17 However the Canadian data cited suggest that the prescription of MPHto older individuals is not the main factor driving increasing prevalence of use. A more cogentargument is an increased frequency of clinical recognition of ADHD resulting from heightenedpublic awareness due to the emergence of effective parent advocacy groups and, in the U.S.,changes in educational law and policy which obligate public schools to identify and serve studentswith ADHD.10 The Canadian situation likely reflects trends in U.S. practices, notwithstanding thefact that similar changes in law and policy have not occurred in Canada.

4.2 Efficacy of MPH4.2.1 Data needs

1. Evidence of the efficacy of MPH in school-aged children.2. Evidence of the efficacy of MPH in adolescents. 3. Evidence of the efficacy of MPH in pre-school-aged children.

Page 10: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

10Review of Therapies - Part 1

4. Evidence of the efficacy of MPH in adults.

4.2.2 Sources of dataOriginal studies of the clinical efficacy of MPH in the non-adult population were sought in thecourse of an exhaustive and systematic search of the ADHD treatment literature, described in Part2 of this report. The search included a variety of electronic databases, handsearching of keyreference lists and bibliographies, and requests for data made to various agencies.

In addition, for this part of the present study we searched the same electronic database describedin Section 4.1.2.1 for overviews and systematic reviews of the efficacy of MPH therapy for all theage groups listed above. We also ran a less exhaustive search for original studies of MPH efficacyin the pre-school and adult populations using Medline.

Finally, the reference lists in Appendix 1 were manually searched for publications relevant to thequestion of efficacy in all age groups.

The materials reviewed specific to this section are listed in Appendices 2, 3 and 4, organized byage group.

4.2.3 Findings4.2.3.1 Efficacy of MPH in school-aged children The evidence from a large number of individual studies and our own meta-analysis which isdescribed in Part 2 of the present series of reports attest to the efficacy of MPH in reducing thesymptoms of ADHD and improving function in various domains, at least over the short term. Inaddition the efficacy of stimulant drugs as a group in ADHD has been evaluated in three formalmeta-analyses collectively involving hundreds of published studies and thousands ofsubjects,18,19,20 a Areview of reviews@21 and a recent systematic review7 (which we howeverconsider as a semi-systematic review because the search for eligible studies was fairly limited,there was minimal information about inclusion and exclusion criteria for potentially eligible studiesand because no attempt was made to evaluate the scientific validity of included studies).

These overviews are consistent in finding significant effects of stimulant drugs in children withhyperactivity, ADD or ADHD. Though the reviews involve stimulant drugs, the findings largelyreflect MPH since it is the agent most frequently used in studies across reviews. Furthermore, the meta-analyses found that MPH does not differ significantly in efficacy from other stimulantssuch as amphetamine and pemoline. Therefore in quoting from this literature, we have usedAMPH@ and Astimulants@ interchangeably.

The previously published meta-analyses show significant effects in all major domains of childfunctioning examined. However the magnitude of these effects varies across domains. The mostpowerful effects are found on measures of observable social and classroom behaviour, with effectsizes (as defined by Kazis et al,22 namely the difference between the means before treatment andafter treatment divided by the standard deviation of the same measure before treatment) rangingfrom .63 to .85. (average .81) and measures of attention, distractibility and impulsivity, rangingfrom .75 to .84 (average .78). Effects on intelligence and achievement tests are more modest

Page 11: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

11Review of Therapies - Part 1

however and range from .19 to .47 (average .34). According to Cohen,23 benchmarks forassessing the relative magnitude of treatment responsiveness are that an effect size of 0.2represents a small change, 0.5, a moderate change, and 0.8, a large change. Another way ofevaluating efficacy is by estimating the proportion of subjects who are judged to show asignificant improvement attributable to MPH (Aresponders@). The 1996 review of Spencer et al.7

found an average response rate of 70% which is very close to the figure of about 75% found byBarkley in a review 20 years ago.13

It should be noted however that while hundreds of studies have demonstrated short-term efficacyof MPH, stimulant treatment in childhood has not yet been demonstrated to have long-termtherapeutic effects.12,24 Various hypotheses have been put forward to account for this discrepantfinding, including the methodological challenges in long-term treatment studies of children withADHD.25 In a formal review of Aextended@ treatment studies, defined as lasting 3 to 7 months,Schachar et al.26 found stimulants to be more effective than placebo, non-pharmacological therapyand no treatment in ameliorating core behavioural symptoms of ADHD. However, few childrenbecame symptom free and there was minimal evidence that stimulant therapy improved cognitivedeficits or associated problems such as conduct disturbance, low self-esteem, poor peerrelationships or academic underachievement.26

4.2.3.2 Efficacy of MPH in adolescentsThere are relatively few treatment studies targeting this particular population and no meta-analyses. The semi-systematic review of Spencer et al.7 examined the use of stimulant drugs inseven studies (four controlled and three open studies) of adolescents with hyperactivity/ADHD. They found the overall rate of response within controlled studies to be highly consistent with thatobserved in school-aged children.

4.2.3.3 Efficacy of MPH in pre-schoolersThere are few studies of drug treatment in this population, in part because MPH is notrecommended for use with children less than 6 years of age.27 Spencer et al reviewed fivecontrolled studies of stimulants with pre-schoolers and concluded that young children respondless well to stimulant therapy than school-aged children. The five studies show considerablevariability across outcome measures and between subjects. A recent and carefully designed trialpublished subsequent to Spencer=s review found substantial improvement in ADHD corebehaviours in their pre-school-aged subjects (effect size of approximately 0.8) but littleimprovement in compliance with parental intsructions.28 Some studies have found negativeeffects on mood and social interactive behaviours with peers among young children onstimulants.29 These and a variety of other unwanted effects have led clinicians and reviewers toconclude that MPH is not as well tolerated by young children as older children and youth, andthat these effects reduce the acceptability of this form of therapy for young children.

4.2.3.4 Efficacy of MPH in adultsThere are relatively few treatment studies targeting this group. Although adult ADHD is aconcept which has gained in recognition and popularity in recent years, as a discrete diagnosticentity and a legitimate focus for therapeutic efforts it remains contentious.30 The semi-systematicreview of Spencer et al.7 and an earlier review of pharmacotherapy of adult ADHD by this same

Page 12: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

12Review of Therapies - Part 1

group31 found conflicting results concerning the efficacy of stimulants for adults with ADHD innine studies (six controlled and three open). The controlled studies showed variableresponsiveness with response rate varying from 25 to 78 % and an overall response rate of 54%,lower than that found for children and youth. One problem with the Spencer review7 is that cleardefinitions of >positive response= are not provided, and it would appear that the reviewers simplyadopted the definitions used in the individual primary studies. The higher figure of 78% is from arecent study which used well-defined diagnostic criteria and robust doses of MPH. Some studieshave reported that side effects and other considerations result in few adults, even responders,maintaining themselves on MPH therapy.

4.2.4 ConclusionsMPH as prototypic of the stimulant drugs has been found to be unequivocally efficacious inreducing symptoms associated with ADHD in school-aged children and youth over the short-term. The most powerful effects are on the core behaviours and associated behaviours such asdisruptive behaviour. Improvements are also found on tests of intellectual functioning andacademic achievement, but these effects are weaker. Efficacy has also been demonstrated for pre-school-aged children, and adults. However in these groups beneficial effects appear to be lessconsistent and adverse effects may render the treatment less acceptable. Long-term therapeuticeffects of MPH have not yet been adequately demonstrated.

4.3 Abuse and/or Illicit Use of MPH4.3.1 Data needs

1. Documentation of the prevalence of abuse or illicit use of MPH.2. Estimation of the risk of abuse or illicit use of MPH3. Documentation of the extent of diversion of MPH

4.3.2 Sources of data4.3.2.1 Computerized DatabasesA search of the Medline database (since 1990) and of Current Contents (since 1995) wasconducted using keywords Aattention deficit hyperactivity disorder@, Amethylphenidate@, Acentralnervous system stimulants@ and cross-referenced with terms such as Aepidemiology@, Aabuse@ andAillicit use@. Relevant article titles and abstracts were scrutinized to seek relevant information.

4.3.2.2 HandsearchingThe Akey@ review articles described in Section 4.1.2.2 (see Appendix 1) were scrutinized andrelevant articles were retrieved and reviewed.

4.3.2.3 Other sourcesData were sought through requests to the office of the Provincial Medical Health Officer of B.C.,and the Canadian Centre on Substance Abuse.

A search of the World Wide Web was done in November 1997 and again in February 1998 usingsearch terms Ritalin and methylphenidate.

Page 13: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

13Review of Therapies - Part 1

4.3.3 FindingsIt is widely appreciated that MPH tablets can be and are illicitly used for a stimulant or euphoriceffect by either ingestion, injection (alone or combined with other drugs) or nasal inhalation. However the extent of abuse of MPH specifically is very difficult to define. No regional or largescale epidemiological studies have been performed to examine the prevalence or pervasiveness ofthe illicit use of MPH (personal communication, E. Single, President of the Canadian Centre onSubstance Abuse; also Rappley M32). A 1993 national survey of U.S. high school senior studentsreported that the illicit use of MPH, reported under the brand name ARitalin@ had remained stableover the previous five years at between 1% and 2% of students surveyed.33 This is significantlylower than the rate of alcohol and marijuana use in the same population.33

Canadian data corroborate the finding that stimulant abuse is less prevalent than cannabis, LSDand cocaine. The percentage of grade 8 to 12 students in B.C reporting illicit use of one of theselast three drugs over a 12-month period was 33.2%, 15%, and 3.7% respectively, compared to2.6% for [email protected] Canadian data also corroborate that the proportion of Canadians who usedLSD, speed or heroin was relatively stable between 1989 (0.4% of the population) and 1993(0.3%).35 The incidence of hospital separations coded as Anondependent abuse of drugs@ duringthe 1992-93 year was very low for Amphetamine Type drugs (4 cases) compared with Cannabis(71 cases), Hallucinogens (34 cases) Morphine Type (44 cases), Cocaine Type 167 (cases) andAOther Abuse@ (351 cases).36

In contrast to the above, material from the U.S. Justice Department=s Drug EnforcementAdministration (DEA) Press Release on MPH dated October 20th, 1995, as obtained from theWorld Wide Web (www.usdoj.gov/dea/pubs/presrel/pr951020.html), refers to A a significant (andincreasing) number of children and adolescents diverting or abusing MPH medication intended forthe treatment of ADHD@ and an increasing number of estimated emergency room mentions ofMPH between 1990 and 1993. It states also that the number of mentions for MPH wassignificantly greater than mentions for Schedule III stimulants (such as amphetamine). Thevalidity of these DEA assertions could not be verified for the purposes of the present report.

In terms of diversion of narcotics and controlled drugs in Canada, the following are noted: thelargest thefts of narcotic drugs included in 1992 include codeine (915,014 tablets), meperidine(70,084 tablets), morphine (97,568 tablets) and oxycodone (307,248 tablets). The largestquantities of stolen controlled drugs for 1992 were MPH (51,356 tablets), phentermine capsules(17,162 capsules), barbiturate tablets (150,592) and steroid tablets (4,800 tabs).35 The U.S.DEA=s Press Release on MPH noted above, notes that MPH ranks in the top ten most frequentlyreported controlled pharmaceuticals stolen from licensed handlers.

4.3.4 ConclusionsReports of 1 B 2% of senior students in the U.S. having used MPH illicitly is indicative of a largenumber of students in absolute terms. However, available published data suggest that abuse/illicituse of MPH is not a major public health problem relative to other illicit drugs. There are twocaveats, however: (1) there are very limited published data on the extent of a problem withabuse/illicit use relating to MPH specifically; and (2) the absence of any published data from thelast three years may camouflage a problem that may be growing as MPH becomes ever more

Page 14: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

14Review of Therapies - Part 1

widely prescribed. There is some indication of such a problem from anecdotal news reports fromthe U.S. about teens selling Ritalin tablets and the DEA data. Regarding a problem with diversionof MPH tablets through theft, there clearly is an illicit market for this drug but its extent andsignificance are difficult to evaluate from currently available data.

4.4 Appropriateness of MPH Prescription4.4.1 PreambleAny evaluation of appropriateness of a behaviour or practice requires the term appropriateness tobe operationally defined. This task involves the application of a set of values which may beguided by scientific evidence or by more subjective individual or collective beliefs. Henceevaluating the appropriateness of prescription of MPH is a complex and difficult task and onewhich we felt could be best addressed by looking for answers to the following questions:1. Is there consensus around how MPH should be prescribed and used?2. How close is the fit between what practitioners currently do and what consensus suggests they

should do? Are there features of current practice that might be readily construed asinappropriate or suspect?

3. What does Aexpert opinion@ say about the appropriateness of current trends in MPHprescription?

4.4.2 Data needsTo address Question 1, we require information from various sources such as formal clinical practice guidelines and other authoritative sources about: (a) preconditions for the prescription ofMPH and directives on when it should and should not be used; (b) practices consistent with safeand responsible prescribing; (c) who should prescribe MPH; and (d) the place of medication in thetreatment regime of a child with ADHD.

To address Question 2, we require information from surveys, audits and other sources to examinephysician practices in relation to prescription and follow-up of patients on MPH.

To address Question 3, we require the comments of experts in child mental health on theappropriateness or otherwise of recent trends in MPH prescription.

4.4.3 Sources of DataElectronic databases. A search of the Medline database was performed using as key wordsADD/ADHD, stimulant medication, methylphenidate and Ritalin. Among the citations obtainedwe focused on diagnosis and management, practice parameters, clinical practice guidelines, physician practice issues and surveys, epidemiology, reviews and commentaries. A search wasalso carried out with the help of University of British Columbia librarians to identify articlespublished in other countries and languages that may not have been indexed in Medline but thatreferred to practice patterns in those countries.

Handsearching of Akey@ review and chapter bibliographies (Appendix 1), of major textbooks onADHD2,37 and of reference lists from available and retrieved papers to identify further relevantpapers. An emphasis in searching for data was on publications since 1995 in leading psychiatric,pediatric or psychological journals.

Page 15: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

15Review of Therapies - Part 1

B.C. Methylphenidate Survey (referenced above).

Review of other published and unpublished materials in the first authors possession.

Personal requests for data from investigators known to be working on surveys of physicianmanagement of ADHD.

4.4.4 Data analysisData describing frequencies and proportions were extracted from individual studies, and arepresented below as raw counts and proportions. At other times, when multiple estimates werefound for a certain variable across studies, these estimates were combined by calculatingarithmetic means.

4.4.5 Findings4.4.5.1 Consensus around how MPH should be prescribed and usedDatabaseA database of 15 sources was assembled and qualitatively analyzed to address this question ofhow MPH should be prescribed and used. These publications were written with a variety ofpurposes and audiences in mind. They did not all purport to be definitive guides on how to usemedication in ADHD. Nevertheless they represent an authoritative body of directives andrecommendations made by experts in four countries (U.S., Canada, U.K and Australia), thatphysicians seeking to learn about ADHD management and the use of MPH would likely refer to.These sources can be categorized as follows:

Guidelines, practice parameters or clinical practice guidelines published by responsible scientificor academic mental health-based groups. Represented here were the American Academy of Childand Adolescent Psychiatry,38 the Committee on Children with Disabilities and Committee onDrugs of the American Academy of Pediatrics,39 the Canadian Paediatric Society,40,41 and theNew South Wales (Australia)Treatment Assessment Group42 (n = 5).

Book chapters from major texts in psychiatry, pediatrics or specific to ADHD (n = 4).43,44,45,46

Recent reviews of ADHD and its treatment by leading clinicians and researchers in the field (n =5).47,48,49,50,51

A survey of attitudes toward treatment of ADHD among 24 leading academic psychiatrists in theU.K.52

These sources are listed in detail in Appendix 5.

ResultsRegarding when to use stimulant medication, the two themes referred to most frequently were (1)the importance of a Acomplete and comprehensive assessment@ or Acareful appraisal@ beforeprescribing medication, and (2) the need to consider symptom severity and degree of functional

Page 16: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

16Review of Therapies - Part 1

impairment in various settings in making decisions about medication (8 and 7 citationsrespectively). These sources note that a complete and comprehensive assessment should includeinformation from multiple sources, aim to establish the diagnosis of ADHD, get a measure ofbaseline functioning and identify associated impairments or needs. Three additional citationsmentioned the importance of the school system having properly evaluated the child, effected themost appropriate placement and ensured appropriate curricula and environmentalaccommodations prior to prescribing medication.

All the above sources were writing about MPH in the context of treatment of ADHD. A numberof sources (n = 4) specifically emphasized the importance of making the diagnosis of ADHD. Oneauthor identified this as being of key importance, noting that ADHD is the only formal indicationfor the prescription of MPH with children, as per product guidelines.27 However several authorspointed out that the decision to use stimulants is not made on the diagnosis alone. Stimulants arenot necessary for all children with ADHD and may be useful for others who have ADHDsymptoms yet do not meet diagnostic criteria, the important factor being the presence of disablingsymptoms that respond to stimulants rather than the presence of a diagnosis.46 Severalexperienced child psychiatrists consulted by the author concurred with this view and indicated thatthey would be willing to conduct a trial of MPH therapy for a child with significant problems ofinattention, distractibility and impulsiveness even if other factors make it difficult or impossible todiagnose ADHD definitively (e.g. presence of associated learning, affective or behaviouraldisorders).

Weiss acknowledges the existence of a Aa wide spectrum of opinion@ among child psychiatristsand psychologists on the use of stimulant medications.46 Four sources note that multiple factorsneed to be considered collectively, including severity of symptoms, preferences of the child andparents, ability of the child, parents and school to cope with the problem behaviours and successand failure of previous treatment44 as well as availability and accessibility of other treatments.2

Most authors acknowledge the centrality of clinical judgement in the decision to recommendmedication47 and that there is no research to guide this decision.46

Regarding the follow-up of a child on stimulant medication, most sources (n = 8) emphasized theimportance of initial evaluation of stimulant efficacy using data from multiple sources andstandardized rating scales. The point is made explicitly by many authorities that a prerequisite forongoing stimulant therapy is the demonstration of significant benefit, defined variably as areduction in behavioural rating scores from 25 - 50% of baseline.50,51 The sources quoted abovealso emphasize the need for periodic monitoring of the child=s progress/status using parent andteacher ratings and academic assessments. Many sources also noted the need for a yearly re-evaluation for the need for medication by observing and assessing the child when off medicationfor several weeks. A number of sources noted the need for monitoring the height, weight andblood pressure of patients on MPH. A wide range of possible dosages in possible with mostsources noting the dose, frequency and timing of administration depend on individual clinicalneeds. A number of authorities stated that doses of over 60 mg of MPH per day were rarelyrequired, presumably following the manufacturer=s specifications.27

Page 17: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

17Review of Therapies - Part 1

Regarding contraindications and cautions, a few sources pointed out that mild impairment andreasonably good academic and behavioural adjustment indicated that MPH should not be used. Similarly if clear evidence was lacking that attentional disorders had led to the child=s social,behavioural and learning difficulties. Psychoses and thought disorder were noted to becontraindications to MPH therapy. In the NSW guidelines, stimulants were contraindicated inchildren under 4 years.42 Weiss notes that stimulants are rarely required under age 6 years46 andindeed the manufacturer does not recommend its use in this group.27 Caution is indicated whencontemplating stimulant drugs with children with tic disorders, extreme anxiety and pervasivedevelopmental disorders.

The question of who should prescribe MPH was largely untouched in the North Americanliterature surveyed above. The Australian group mentions the assessment leading to initialprescription of stimulants is limited to consultant pediatricians, consultant child psychiatrists andother specially authorized medical practitioners.42 In Sayal=s U.K survey, about half of therespondents (themselves psychiatrists) felt that MPH should only be initiated by child psychiatristsand half felt that pediatricians should be able to initiate it.52 The vast majority agreed with generalpractitioners continuing the prescriptions until the next specialist review.52

Finally, regarding the role of MPH vis a vis alternative treatment strategies, four sourcesspecifically endorsed the view that medication should be used only as part of a morecomprehensive treatment approach which includes behavioural and educational therapy strategies. About half of the U.K respondents felt it should only be used as an adjunct to psychologicaltherapies.52 A number of additional authorities referred to the need to ensure that MPH not beused as a substitute for appropriate educational interventions and that school programmatic andenvironmental modifications and the involvement of the school psychologist are all in place.

4.4.5.2 Physician practices in relation to prescription and follow-up of patients on MPHDatabaseEight surveys of physician practices with regard to the management of children and youth withADHD published or conducted in the past ten years were identified . Six of these surveys havebeen published in peer-reviewed journals. The two unpublished surveys have been conductedonly recently, and in one of them, data have not yet been completely analyzed. However theinvestigator (R. Bergen, Department of Psychology, Geneva College, Pennsylvania) kindly agreedto share preliminary data. Finally, the BC Methylphenidate Survey database was searched forevidence of practices that might be construed as raising serious doubts about appropriateness. The eight studies can be briefly characterized as follows:

_ A recent survey of 788 parents of children in New South Wales, Australia (NSW study) whohad received prescriptions for stimulant drugs.53

_ A survey of B.C doctors who had prescribed MPH for children with ADHD.54

Page 18: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

18Review of Therapies - Part 1

_ Two studies of the practices of family practitioners in the U.S.55,56

_ Two studies of the practices of pediatricians in the U.S.57,58

_ A recent survey of 341 pediatric subspecialists in developmental-behavioural pediatrics(DBP=s) and 209 general pediatricians in the U.S. (M. Reiff ADHD Diagnosis Survey, 1996,unpublished)

_ A recent survey of 646 physicians mainly in the U.S., including psychiatrists, child andadolescent psychiatrists, pediatricians, DBP=s, family practitioners and Aothers@ (M. Bergen ADHD Physician Prescription Practices Questionnaire, 1996, unpublished)

These sources are listed in detail in Appendix 6. The under-representation of surveys ofpsychiatrists= practice patterns is notable in view of the fact that many of the defining guidelinesdescribed above were produced by psychiatrists.

The completion rates and methodology of each of the eight surveys were different but there wassufficient commonality to be able to extract and synthesize data across surveys that related to theprincipal points of consensus on appropriate prescribing practices described earlier. It should benoted that an average of 53% of subjects responded in seven surveys (range 38% B 75%). Therefore the results are likely to reflect practice patterns of more highly motivated physicians,who may also be more likely to be assiduous in their management of children with ADHD.

ResultsRegarding the methods and comprehensiveness of assessment prior to prescribing medications, anaverage of 75% of respondents (range 55% - 95%) reported communication with schools andteachers or reading of school records/reports (n = 5 studies).

Regarding the use of rating scales, an average of 51% (range 20% - 75%) and 46% (range 29% -62%) of respondents respectively reported using parent and teacher scales (n = 3 studies). InReiff=s survey, however, subspecialist pediatricians (DBP=s) reported using parent or teacherscales 84% of the time. In Bergen=s mixed sample of physician types, 75% reported using >ratingscales= (not further specified) frequently or almost always.

Regarding obtaining psychometric or psychoeducational testing, an average of 60% ofrespondents reported getting this done (n = 3 studies) and an additional study reported 82% ofrespondents obtained testing on A more than 50% of their [email protected] It should be noted thatamong these four sources, only a minority of respondents were primary care physicians.

Regarding making the diagnosis of ADHD and criteria used, two studies each reported that 43%of physicians in those surveys referred patients out for diagnosis. Among physicians making thediagnosis themselves, there was a wide range in respondents who made specific use of DSMcriteria, from 25% among family practitioners56 and unspecified physicians54 to 58% amonggeneral pediatricians and 76% among DBP=s (Reiff survey). In this latter survey, 76% of DBP=sfound DSM criteria to be Aessential for the diagnosis@ compared with 58% of general pediatricianssurveyed. It is notable from this study also that 89% and 74% of DBP=s and general pediatriciansrespectively reported using a Aconsistent set of criteria@ to make the diagnosis, but that only inabout 10% of cases were the responses they provided in an open-ended question in the survey

Page 19: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

19Review of Therapies - Part 1

judged to be specific enough to be reproducible as criteria. In a similar vein, among Bergen=srespondents, 65% reported use of DSM - IV criteria: 18% DSM alone; 34.8% DSM plus clinicaljudgement; 10.5% DSM, clinical judgement and other method, and 1.4% DSM plus other method(Bergen survey).

Regarding evaluation of efficacy, only one study looked at the monitoring of initial response tomedication. The most frequent methods were by parent report of changes in behaviour (78% ofrespondents) and teacher report of changes in behaviour (57%).53 Other studies reported in aninformal way that continued monitoring relied largely on periodic re-evaluations using parentreports and use of teacher rating scales used in 34% B 56% of cases (n = 2 studies). Periodicmonitoring of height and weight was reported in three studies with an average of 76% ofphysicians performing these measurements. ADrug holidays@ or annual periods off medications were practised by an average of 67%respondents (n = 4 studies) though not apparently with the intent to evaluate an ongoing need formedication. In the NSW study, 34% did have annual drug-free periods to determine continuedrequirement, but in only 10% did this period take place during the school term.53

Regarding use of other modalities of therapy, 48% of family practitioners reported usingbehavioural therapy56 and 26% reported using it as a first line treatment,55 while 70% ofpediatricians used it Amoderately [email protected] By parent report, 38% received behaviouralmanagement advice in the New South Wales study, 30% received extra classroom support forbehaviour, and 20% B 34%, some form of psychological therapy.53

Regarding age limits for the use of stimulant drugs, 33% of pediatricians and 16% of familypractitioners reported treating children under kindergarten age with stimulants.57,56

Across these surveys, interesting differences in the practice patterns of different specialties ofphysicians emerged. Some of these differences are covered above and other notable instancesfollow: (1) in terms of time devoted to an ADHD consultation, family practitioners spend theleast time on average, general pediatricians an intermediate amount of time and specialists indevelopmental-behavioural pediatrics (DBP=s) the longest time; (2) DBP=s reported an average of3.8 criteria or clinical indicators as critical to making the diagnosis of ADHD (including forexample the use of DSM criteria, obtaining teacher information and consideration of comorbidity)while general pediatricians reported 1.8 such criteria or indicators (Reiff, unpublished); (3)consideration of comorbidity was considered essential in 91% of subspecialist DBP=s but only by46% of general pediatricians (Reiff survey); (4) 84% of family practitioners feel that observedbehaviour in the office is important diagnostically compared with 64% of pediatricians56; and (5)child psychiatrists report using the highest doses of stimulants and family practitioners the lowestdoses (R. Bergen, personal communication).

Bergen=s preliminary results also indicate differences in the exposure of physicians from differentspecialties to education about the management of ADHD. A significantly greater proportion ofphysicians affiliated with the American Academy of Child and Adolescent Psychiatry (94%) or theSociety for Developmental-Behavioural Pediatrics (90%) reported receiving recent continuing

Page 20: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

20Review of Therapies - Part 1

medical education on ADHD than physicians affiliated with the American Academy of Pediatrics(33.5%) or the American Academy of Family Practice (67%). Pediatricians affiliated with theAmbulatory Pediatric Association were intermediate (71% with recent exposure to continuingmedical education in this area)(Bergen survey).

Finally, there was evidence of dubious practices patterns of MPH prescription to children (< 19years ) in the province of BC from analysis of the BC MPH Survey database in a number of areas. However the methodology used to identify these situations precludes the examination of individual circumstances, so this evidence can only be considered indirect. The dubious areaswere as follows: (1) almost 0.7% of all prescriptions to children during the years 1990 to 1994were written by physician specialties who would not customarily be expected to be involved in themanagement of ADHD in children and youth. These included general surgeons, medicalmicrobiologists and casualty officers. Of course, some of these physicians may be registered inone specialty but also function in the role of a general practitioner; also, errors in database codingmay account for some instances of prescribing attributed to unexpected sources; (2) the averageprevalence of prescriptees per 1000 children across local health regions in the province of B.C.was 9.42, but the prevalence rates vary from a low of 6.51 to 22.74 per 1000. The prevalence ofprescription between health regions thus varies by a factor of 3.5 and there is no readily apparentexplanation for why this should be so. The low rate quoted above is for a large, mixed-incomeurban region (Vancouver) while the high rate is for prevalence in a smaller, more rural setting (theThompson region); and (3) children under 5 years of age accounted for 3% of prescriptees,possibly an indicator of questionable practice in view of the manufacturers guidelines. In addition,we examined the frequency of children receiving just a single prescription of MPH during theseven-year study window. An early estimate of over 50% for this Aone-only@ phenomenon fromthe U.S.59 seemed to indicate highly questionable management practices. In B.C. on the otherhand, this occurrence was found in only 19.1% of MPH prescriptees, which does not appear highgiven what is known from published studies of expected rates of positive and adverse responses.

4.4.5.3 AExpert opinion@ on the appropriateness of current trends in MPH prescriptionDatabaseThis question has been addressed in passing in articles, editorials and letters in the medical andmental health literature as well as in the media. References to this question were sought throughelectronic database searching (Medline) and review of material collected over several years by thefirst author. It was impossible to be highly structured in pursuing this question in view of therange of settings in which assertions have been made and of opinions. Hence a sampling ofcomments and opinions from publications in the mainstream medical, psychiatric andpsychological literature and from Reiff=s unpublished survey is provided here to illustrate thethemes used in arguing this question and the spectrum of opinion that exists.

Details of the sources cited are listed in Appendix 7.

ResultsIn Reiff=s Survey (M. Reiff. ADHD Diagnosis Survey, 1996, unpublished) of 550 general andsubspecialist pediatricians and psychologists, 70% felt that ADHD is over-diagnosed, 22% that itis not over-diagnosed, and 24% that it is under-diagnosed. In terms of factors believed to be

Page 21: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

21Review of Therapies - Part 1

associated with overuse of stimulant medication, 78% endorsed lack of a thorough evaluation,49% endorsed that the children may meet criteria for ADHD but actually have other disorderswhich appear to be ADHD, and 38% endorsed that children may not meet DSM criteria forADHD.Swanson et al., argue that the increasing rate of ADHD diagnosis and MPH prescription followsan increased frequency of its clinical recognition as a result of heightened public awarenesssecondary to the emergence of effective parent advocacy groups and changes in educational lawand policy (in the U.S.) which obligate public schools to identify and serve students with ADHD.10

Shaywitz and Shaywitz note that the increased use of stimulants might Areflect a regressive step inwhich all behavioural and learning disorders are indiscriminately lumped together and treated inthe same way. Conversely, the use of stimulant medication in newly recognized populations ofaffected children Y may reflect an increased awareness of newer concepts of behavioural andattention disorders in which the central role of inattention in the genesis of school problems [email protected]

Continuing this demographic trend of argument, Garber et al.,60 conclude that Atoo many@ childrenare not being placed on medication for ADHD because population estimates of the prevalence ofdiagnosed ADHD in the U.S. are around over 2 million children, but a substantially lower number(750 000 to 1.6 million) are treated with MPH.

A pragmatic argument is that since stimulant medications are safe and often effective, this form oftreatment is appropriate and useful for children with ADHD. Safer17 cites two studies whichconverge in showing that about 75% of children on stimulant medication clearly and measurablybenefit from it. He also notes that parent satisfaction with the results of maintained stimulanttreatment averages around 90%.17 On the other hand, Oberklaid and Jarman61 note that the factthat stimulants work so well creates a problem in that other components of a good managementplan (classroom adaptation, remedial teaching, parent training, cognitive/behavioural therapy) areoften not implemented, either because they are not readily available or because they are tooexpensive.

In a thoughtful paper, Diller62 notes that Afor many physicians, psychologists and educators theidentification of potential ADHD and consequent stimulation medication are meeting an importantneed of the community@. However he goes on to say that the Athe ADHD/stimulant phenomenonmay reflect how the demands on children and families have increased as the social networksupporting them has declined@ and that Athe rise in stimulants is alarming and signals an urgentneed for American society to re-evaluate its [email protected] This theme is echoed by Vimpani fromAustralia16 who notes that the clinician=s desire to help the child and family by using stimulantsmay at times conflict with pediatricians= collective advocacy role to promote a healthy society forchildren. Arguing that children in contemporary industrialized societies are exposed to manysources of social, familial and economic stress and that negative and disruptive behaviours inchildren may be manifestations of environmental distress, Vimpani argues that prescribingstimulants for such behaviour disorders may sometimes be against the best interests of the child.16

Page 22: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

19Review of Therapies - Part 1

Finally, an indirect comment on medication appropriateness is contained in the observations ofSchachar et al. 63 that in the U.S., as many as 75% of children with a clinical diagnosis ofhyperactivity are treated with stimulants whereas medication is prescribed less frequently inCanada and is rarely used in Britain and Europe. “In these countries psychological interventions,particularly therapy aimed at altering parenting strategies, are the preferred therapy forhyperactive children. European clinicians seem to focus on the conduct disturbance and theemotional problems of hyperactive children and direct therapy toward mitigating deficientparenting practices, disturbance in family functioning and the psycho-educational deficits of thechildren”. 63

4.4.6 Conclusions1. There is a wide-spectrum of opinion on many aspects of care of children with disorders of

learning and behaviour who may have ADHD. There are no gold standards in theirmanagement and clinical judgement has an important role to play, as it presumably does inmany aspects of clinical practice. However there is considerable consensus on the need for athorough and detailed assessment that includes consideration of (a) the functional severityand impact of symptoms, (b) multiple factors in relation to the child (especially associatedimpairments or diagnoses), school and family, and (c) a range of possible foci of intervention.

2. There are important differences in the ways that physicians from different professionalbackgrounds evaluate and manage children with ADHD. The weight of consensus opinionfavours the more thorough, detailed and careful procedures that are associated with specialistrather than primary care practice.

3. Synthesizing results across published surveys on a range of practices, we find that only rarelydoes physician practice accord with published guidelines more than 70% of the time. Henceit would not be unreasonable to suspect suboptimal management practices in at least 30% ofcases of ADHD. Such practices would involve insufficient care and thoroughness at thelevels of evaluation, monitoring and attention to other important management prerequisites. Considering that published surveys probably reflect the practices of more motivated andinterested clinicians, it seems likely that the above figure represents an underestimate of theextent of deficiencies with regard to ADHD management and medication use. Furthermorewhen one considers what can realistically be accomplished in a 15- or even a 45-minutephysician consultation and the time taken to contact teachers during initial evaluation of thechild and for evaluation of medication efficacy, it is quite clear that the care of many childrenwould be considered suboptimal, at least in relation to published guidelines which are the ideals.

4. While “suboptimal management” of ADHD is not synonymous with inappropriateprescription of stimulant drugs, it seems reasonable to conclude that in a significant minorityof cases MPH may be prescribed to children inappropriately. The size of this minority canonly be guessed at following the review above, and could range from 10% to 40% of treatedcases. To estimate this proportion empirically would require a community-based audit of themanagement of a large number of cases of ADHD and the adoption of some kind of “goldstandard” for management, which would be difficult to accomplish.

5. When noting “suboptimal management” of ADHD and inappropriate prescription ofstimulant drugs it is important that the situation be viewed in the context of current NorthAmerican social-cultural attitudes and pressures, as well as the political and economicrealities of service delivery in the education and health care sectors.

Page 23: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

24Review of Therapies - Part 1

References

1. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders(4th ed). Washington, D.C., 1994

2. Barkley R. Attention Deficit Hyperactivity Disorder. A Handbook for Diagnosis andTreatment. New York: Guildford Press, 1990

3. Shaywitz SE, Shaywitz BA. Attention deficit disorder: diagnosis and role of Ritalin inmanagement. In: Greenhill LL, Osman BB (Eds), Ritalin: Theory and PatientManagement. New York: Mary Ann Liebert, Inc., 1991.

4. Weinberg WA, Brumback RA. The myth of attention-deficit-hyperactivity disorder:symptoms resulting from multiple causes. J Child Neurology 1992;7:431-445.

5. Schrag P, Divoky D. The Myth of the Hyperactive Child and Other Means of Child Control. New York: Pantheon Books, 1975.

6. Greenhill, LL. Attention-deficit hyperactivity disorder: the stimulants. Child AdolescPsychiatr Clinics North Am 1995;4:123-168.

7. Spencer T, Biederman J, Wilens T, Harding M, O=Donnell D, et al. Pharmacotherapy ofattention deficit hyperactivity disorder across the life cycle. J Am Acad Child AdolescPsychiatry 1996; 35:409-432.

8. Richters JE, Arnold LE, Jensen PS, Abikoff H, Conners CK et al. NIMH CollaborativeMultisite Multimodal Treatment Study of Children with ADHD: I. Background & rationale. J Am Acad Child Adolesc Psychiatry 1995, 34:987-100.

9. Safer DJ, Zito JM, Fine EM. Increased methylphenidate usage for attention deficit disorder in1990s. Paediatrics 1996;98:1084-1088.

10. Swanson JM, Lerner M, Williams L. More frequent diagnosis of attention deficit-hyperactivity disorder. NEJM 1995;333:944.

11. Safer DJ, Krager, JM. A survey of medication treatment for hyperactive/inattentivestudents. JAMA 1988;260:2256-2258.

12. Jacobvitz DL, Sroufe A, Stewart M, Leffert N. Treatment of attentional and hyperactivityproblems in children with sympathomimetic drugs: a comprehensive review. J Am AcadChild Adolesc Psychiatry 1990;29:667-688.

13. Barkley RA. A review of stimulant drug research with hyperactive children. Journal ofChild Psychology and Psychiatry 1977;18:137-165.

Page 24: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

25Review of Therapies - Part 1

14. Satterfield JH, Satterfield BT, Cantwell DP. Three-year multimodality treatment study of100 hyperactive boys. J Peds 1981;98:650-655.

15. Jureidini J. Some reasons for concern about attention-deficit hyperactivity disorder. JPaediatr Child Health 1996;32:201-203.

16. Vimpani GV. Prescribing stimulants for disruptive behaviour disorders: sometimes againstthe best interest of the child. Journal of Paediatric Child Health 1997;33:9-11.

17. Safer, DJ. Major treatment consideration for attention deficit hyperactivity disorder. Current Problems in Pediatrics 1995;25:137-143.

18. Kavale K. The efficacy of stimulant drug treatment for hyperactivity: A meta-analysis. Journal of Learning Disabilities 1982; 15:280-289.

19. Ottenbacher KJ, Cooper HM. Drug treatment of hyperactivity in children. Dev Med ChildNeurol 1983; 25:358-366.

20. Thurber S, Walker CE. Medication and hyperactivity: a meta-analysis. J Gen Psychol 1983;108:79-86.

21. Swanson JM, McBurnett K, Wigal T, Pfiffner LJ, Lerner MA. Effect of stimulantmedication in children with attention deficit disorder: a Areview of reviews@. ExceptionalChildren 1993;60:154-162.

22. Kazis LE, Anderson JJ, and Meenan, R.F. (1989) Effect sizes for interpreting changes inhealth status, Medical Care, 27: S178-89).

23. Cohen J. Statistical power analysis for the behavioural sciences. New York: AcademicPress, 1977.

24. Weiss G, Hechtman LT. Hyperactive Children Grown UP: ADHD in Children, Adolescentsand Adults. New York: Guildford, 1993

25. Weiss G. Attention deficit hyperactivity disorder. In Lewis M (Ed). Child and AdolescentPsychiatry: a Comprehensive Textbook (2nd ed). Baltimore, Williams & Wilkins, 1996

26. Schachar R, Tannock R. Childhood hyperactivity and psychostimulants: a review ofextended treatment studies. J Child Adolesc Psychopharmacol 1993;3:81-97

27. Novartis Inc. Ritalin product monograph. Compendium of Pharmaceuticals and Specialities,Pharmaceutics Association of Canada, Ottawa, 1998

28. Musten LM, Firestone P, Pisterman S et al. Effects of methylphenidate on pre-schoolchildren with ADHD: cognitive and behavioural functions. J Am Acad Child Adolesc

Page 25: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

26Review of Therapies - Part 1

Psychiatry 1997;36:1407-1415

29. Shellfire M, Weiss G, Cohen N et al. Hyperactivity in pre-schoolers and the effect ofmethylphenidate. Amer J Orthopsychiat 1975;45:38-50

30. Shaffer D. Attention deficit hyperactivity disorder in adults. Am J Psychiatry 1994;51:633-638

31. Wilens TE. Biederman J. Spencer TJ. Prince J. Pharmacotherapy of adult attention deficit/hyperactivity disorder: a review. Journal of Clinical Psychopharmacology 1995; 15:270-9

32. Rappley M: Safety issues in the use of methylphenidate. An American perspective. DrugSafety 1997;17:143-148

33. Johnston LD, O=Malley PM, Bachman JG: National survey results on drug use for themonitoring the future study, 1975 B 1994: Volume 1, secondary school students. Washington DC: National Institute of Health, 1995: Rep. No. 95-4026

34. Institute for Health Promotion Research. School-based prevention project evaluation: student survey Spring 1993. Faculty of Graduate Studies, University of B.C., Vancouver

35. McKenzie D and Williams B: Canadian Profile 1995. Licit and Illicit Drugs. CanadianCentre on Substance Abuse, Ottawa, 1995

36. B.C. Ministry of Health and Ministry Responsible for Seniors: Hospital Separations in B.C.for Drug Use Problems. Information Systems, Inpatient Program Branch, 1994 andreported in Province of B.C. Ministry of the Attorney General. Prevalence and Incidence ofIllicit Drug Use in British Columbia: an update. Coordinated Law Enforcement Unit, 1994

37. Sandberg S. Hyperactivity Disorders of Childhood. Cambridge: Cambridge UniversityPress, 1996

38. American Academy of Child and Adolescent Psychiatry. Practice parameters for theassessment and treatment of children, adolescents and adults with attention-deficithyperactivity disorder. Journal of the American Academy of Child Adolescent Psychiatry1997; 36(10 Supplement):85S-121S

39. Committee on Children with Disabilities and Committee on Drugs. Medication for childrenwith attentional disorders. Pediatrics 1996;98(2):301-304

40. Mental Health Committee, Canadian Pediatric Society. Use of methylphenidate for attentiondeficit hyperactivity disorder. Canadian Medical Association Journal 1990;142(8):817-818.

41. Mental Health Committee, Canadian Pediatric Society. Hyperactivity in children. CanadianMedical Association Journal 1988;139:211-212.

Page 26: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

27Review of Therapies - Part 1

42. New South Wales Therapeutic Assessment Group. Treatment of Attention DeficitHyperactivity Disorder with Central Nervous System Stimulants. Position Paper. NewSouth Wales: NSW TAG, 1993.

43. DuPaul GH, Barkley BA. Medication therapy. In: Barkley RA (ed.), Attention-DeficitHyperactivity Disorder: A Handbook for Diagnosis and Treatment. New York: GuildfordPress, 1990.

44. Rapoport JL, Castellanos FX. Attention-deficit/hyperactivity disorder. In: Weiher JM (ed.),Diagnosis and Psychopharmacology of Childhood and Adolescent Disorders. 2nd ed. NewYork: Wiley, 1996.

45. Sandberg S, Day R, Trott GE. Clinical aspects. In: Sandberg S (ed.), HyperactivityDisorders of Childhood. Cambridge: Cambridge Univ. Press, 1996. 69-110.

46. Weiss G. Attention deficit hyperactivity disorder. In: Lewis M (ed.), Child and AdolescentPsychiatry: A Comprehensive Textbook. 2nd ed. Baltimore: Williams and Wilkins, 1996.

47. Shaywitz BA, Fletcher JM, Shaywitz SE. Attention-deficit/hyperactivity disorder. In:Advances in Paediatrics 1997;44:331-367.

48. Carrey NJ, Wiggins DM, Milin RP. Pharmacological treatment of psychiatric disorders inchildren and adolescents: focus on guidelines for the primary care practitioner. Drugs1996;51(5):750-759

49. Elia J. Drug treatment for hyperactive children: therapeutic guidelines. Drugs1993;46(5):862-871

50. Greenhill LL. Attention-deficit hyperactivity disorder. Pediatric Psychopharmacology1995;4(1):123-169

51. Safer DJ. Central stimulant treatment of childhood attention deficit hyperactivity disorder:issues and recommendations from a US perspective. CNS Drugs 1997;7(4):264-272

52. Sayal K, Taylor E. Drug treatment in attention deficit disorder: a survey of professionalconsensus. Psychiatric Bulletin 1997;21:398-400

53. Hazell PL, McDowell MJ, Walton JM. Management of children prescribed psychostimulantmedication for attention deficit hyperactivity disorder in the Hunter region of NSW.Medical Journal of Australia 1996;165:477-480

54. Ruel J-M, Hickey CP. Are too many children being treated with methylphenidate? CanadianJournal of Psychiatry 1992;37(8):570-572

Page 27: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

28Review of Therapies - Part 1

55. Moser SE, Kallail KJ. Attention-deficit hyperactivity disorder: management by familyphysicians. Archives of Family Medicine 1995;4:241-244

56. Wolraich M, Lindgren S, Stromquist A, Milich R, Davis C, Watson D. Stimulant medicationuse by primary care physicians in the treatment of attention deficit hyperactivity disorder.Pediatrics 1990;86(1):95-101

57. Copeland L, Wolraich M, Lindgren S, Milich R, Woolson R. Pediatricians= reportedpractices in the assessment and treatment of attention deficit disorders. Developmental andBehavioural Pediatrics 1987;8(4):191-197

58. Kwasman A, Tinsley BJ, Lepper HS. Pediatricians= knowledge and attitudes concerningdiagnosis and treatment of attention deficit and hyperactivity disorders. Archives ofPediatric and Adolescent Medicine 1995;149:1211-1216

59. Sherman M, Hertzig ME. Prescribing practices of Ritalin: the Suffolk County, New YorkStudy. In: Greenhill, LL, Osman BB (Eds), Ritalin: Theory and Patient Management. NewYork: Mary Ann Liebert, 1991

60. Garber SW, Garber MD, Spizman RF. Beyond Ritalin: Facts about Medication and OtherStrategies for Helping Children, Adolescents, and Adults with Attention Deficit Disorders.New York: Harper Perrenial, 1996

61. Oberklaid F, Jarman FC. Paying attention to ADHD. Journal of Paediatric Child Health1996;32:207-208

62. Diller LH. The run on Ritalin: attention deficit disorder and stimulant treatment in the1990s. Hastings Centre Report 1996;26(2):12-18

63. Schachar R, Tannock R, Cunningham C. Treatment. In: Sandberg S (ed), HyperactivityDisorders of Childhood. Cambridge: Cambridge UP, 1996. 433-476

Page 28: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

29Review of Therapies - Part 1

LIST OF FIGURES B PART 1

Figure 1 Consumption of Methylphenidate in Canada, 1982-1996Figure 2 Prescriptions of Methylphenidate Dispensed in a Sample of Canadian Retail

Pharmacies, 1990-1996Figure 3 Prescriptions of Methylphenidate Dispensed in a Sample of Canadian Retail

Pharmacies, 1992-1996, by RegionFigure 4 Prescriptions of MPH in British Columbia, 1990-1996Figure 5 Recipients (<19 yrs) of Prescriptions of MPH in BC by Age Group and Gender,

1990-1996Figure 6 Prevalence of MPH Use in Children in BC, 1990 B 1996Figure 7 Incidence of MPH Use in Children in BC, Child Prescriptees Receiving their First

Prescription Recorded during the Period 1990 B 1996Figure 8` Methylphenidate 10 mg Tablets Dispensed to Males in Saskatchewan, 1991 B 1995Figure 9 Methylphenidate 10 mg Tablets Dispensed to Females in Saskatchewan, 1991 B

1995Figure 10 Prevalence of Methylphenidate Treatment among Baltimore County Public School

Students (5-17 years), 1991 B 1995Figure 11 Prevalence of Stimulant Medication Use Among Males 6-12 Years of Age in New

South Wales, Australia, 1988 B 1993

Page 29: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Figure 1. Consumption of Methylphenidate in Canada, 1982 - 1996

0

100

200

300

400

500

600

1983

1984

1985

1986

1987

1988

1989

1990

1991

1992

1993

1994

1995

1996

Year

Source: Health Canada

MPH Consumption*

(kg of base)

* Consumption of MPH represents the different between (Stock on Hand from the previous year plusImports for the current year) and (Stock on Hand at the end of the current year plus Exports for thecurrent year).

Page 30: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

0

100

200

300

400

500

600

700

1991 1992 1993 1994 1995 1996Year

Number of Prescriptions (in thousands)

Figure 2. Prescriptions of Methylphenidate Dispensed in a Sample of Canadian Retail Pharmacies, 1990 - 1996 (see text)

Source: IMS Canada, Compuscript

Page 31: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Figure 3. Prescriptions of Methylphenidate Dispensed in a Sample of Canadian Retail Pharmacies, 1992 – 1996, by Region

0

50

100

150

200

250

Number of Prescriptions

Dispensed(in thousands)

1992 1993 1994 1995 1996

Year

Ontario

Quebec

Prairies

B.C.

Maritimes

Page 32: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Figure 4. Prescriptions of MPH in British Columbia, 1990 - 1996

Source: BC Methylphenidate Survey

0

5000

10000

15000

20000

25000

30000

35000

40000

Number of Prescriptions

1990 1991 1992 1993 1994 1995 1996

Year

ChildrenAdult

Page 33: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Figure 5. Recipients (<19yrs) of Prescriptions of MPH in BC by Age Group and Gender,1990-1996

Source: BC Methylphenidate Survey

0

1000

2000

3000

4000

5000

6000

7000

8000

Number of Prescriptees

Male Female

Gender

Age 0-4

Age 5-9

Age 10-14

Age 15-19

Page 34: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Figure 7. Incidence of MPH Use in Children in BC, Child Prescriptees Receiving their First Prescription Recorded during the Period, 1990 – 1996

Source: BC Methylphenidate Survey

0

2

4

6

8

10

12

Prescriptees(per 1000 children)

1990 1991 1992 1993 1994 1995 1996

Year

0

2

4

6

8

10

12

Prescriptees (per 1000 children)

1990 1991 1992 1993 1994 1995 1996

Year

Figure 6. Prevalence of MPH Use in Children in BC, 1990 - 1996 Source: BC Methylphenidate Survey

Page 35: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Figure 8. Methylphenidate 10mg Tablets Dispensed to Males in Saskatchewan, 1991 - 1995

0

100000

200000

300000

400000

500000

600000

700000

800000

900000

1000000

1-20 years 21-40 years 41-60 years 60+ years Total

Age Group

Total Number of Tablets

1991

1992

1993

1994

1995

Source: Saskatchewan Triplicate Prescription ProgramCourtesy Dr. Declan Quinn

Page 36: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Figure 9. Methylphenidate 10mg Tablets Dispensed to Females in Saskatchewan, 1991 - 1995

0

50000

100000

150000

200000

250000

1-20 years 21-40 years 41-60 years 60+ years Total

Age Group

Total Number of Tablets

1991

1992

1993

1994

1995

Source: (see Figure 8)

Page 37: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

0

5

10

15

20

25

30

35

40

1991 1993 1995

Year

Figure 10. Prevalence of Methylphenidate Treatment among Baltimore County Public School Students (5-17 years), 1991 - 1995

Youth Prescriptees

(Rate per 1000)

Abstracted from data in Safer DJ, Zito JM, Fine EM. Increased methylphenidate usage for attentiondeficit disorder in 1990s. Paediatrics 1996;98:1084-1088.

Page 38: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Figure 11. Prevalence of Stimulant Medication Use Among Males 6-12 Years of Age inNew South Wales, Australia, 1988 - 1993

0

1

2

3

4

5

6

7

8

9

1988 1989 1990 1991 1992 1993

Year

Percentage on Stimulant

Medication (Rate per 1000)

Abstracted from Valentine J, Zubrick S & Sly P. National trends in the use of stimulant medicationfor attention deficit hyperactivity disorder. J Paediatr Child Health1996;32:223-227.

Page 39: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Appendix 1: Key Sources for Handsearching

Abikoff HB, Hechtman L. Multimodal therapy and stimulants in the treatment of children withattention deficit hyperactivity disorder. In: Hibbs ED, Jensen PS (Eds). Psychosocial treatmentsfor child and adolescent disorders: Empirically Based Strategies for Clinical Practice. Washington, D.C., American Psychological Association, 1996

Cantwell DP. Attention deficit disorder: a review of the past 10 years. J Am Acad Child AdolescPsychiatry 1996; 35: 978-987

Dulcan M and the American Academy of Child and Adolescent Psychiatry Work Group onQuality Issues. Practice parameters for the assessment and treatment of children, adolescents andadults with attention-deficit hyperactivity disorder. J Am Acad Child Adolesc Psychiatry 1997;36(Suppl): 85S-121S

Rapopport JL, Castellanos FX. Attention-deficit/hyperactivity disorder. In Weiner HM (Ed). Diagnosis and Psychopharmacology of Childhood and Adolescent Disorders, (2nd Ed). NewYork, Wiley 1996

Richters JE, Arnold LE, Jensen PS, Abikoff H, Conners CK et al. NIMH Collaborative MultisiteMultimodal Treatment Study of Children with ADHD: I. Background & rationale. J Am AcadChild Adolesc Psychiatry 1995, 34:987-100

Schachar R, Tannock R, Cunningham C. Treatment. In Sandberg S (Ed). HyperactivityDisorders of Childhood. Cambridge, Cambridge University Press, 1996

Shaywitz BA, Fletcher JM, Shaywitz SE. Attention-deficit hyperactivity disorder. Advances inPediatrics 1997; 44:331-367

Spencer T, Biederman J, Wilens T, Harding M, O=Donnell D, et al. Pharmacotherapy of attentiondeficit hyperactivity disorder across the life cycle. J Am Acad Child Adolesc Psychiatry 1996;35:409-432

Waslick B, Greenhill L. Attention-deficit hyperactivity disorder. In Wiener J (Ed). Textbook ofChild and Adolescent Psychiatry (2nd ed). Washington DC, American Psychiatric Press, 1997

Weiss G. Attention deficit hyperactivity disorder. In Lewis M (Ed). Child and AdolescentPsychiatry: a Comprehensive Textbook (2nd ed). Baltimore, Williams & Wilkins, 1996

Page 40: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Appendix 2: Sources of Information on Efficacy of Methylphenidate withAdolescents

Brown RT, Borden KA, Clingerman SR. Pharmacotherapy in ADD adolescents with specialattention to multimodality treatments. Psychopharmacology Bulletin 1985;21(2):192-211.

Brown RT, Borden KA. Hyperactivity in adolescence: some misconceptions and new directions.Journal of Clinical Child Psychology 1986;15(3):194-209.

Brown RT, Sexson SB. A controlled trial of methylphenidate in black adolescents: attentional,behavioural and physiological effects. Clinical Pediatrics 1988;27(2):74-81.

Coons HW, Klorman R, Borgstedt AD. Effects of methylphenidate on adolescents with achildhood history of attention deficit disorder: II. Information processing. Journal of theAmerican Academy of Child and Adolescent Psychiatry 1987;26(3):368-374.

Evans SW, Pelham WE. Psychostimulant effects on academic and behavioural measures forADHD junior high school students in a lecture format classroom. Journal of Abnormal ChildPsychology 1991;19(5):537-552.

Faigel HC, Sznajderman S, Tishby O, Turel M, Pinus U. Attention deficit disorder duringadolescence: a review. Journal of Adolescent Health 1995;16:174-184.

Gittelman Klein R. Prognosis of attention deficit disorder and its management in adolescence.Pediatrics in Review 1987;8(7):216-222.

Greenhill LL, Setterberg S. Pharmacotherapy of disorders of adolescents. Psychiatric Clinics ofNorth America 1993;16(4):793-815.

Klorman R, Coons HW, Borgstedt AD. Effects of methylphenidate on adolescents with achildhood history of attention deficit disorder: I. Clinical findings. Journal of the AmericanAcademy of Child and Adolescent Psychiatry 1987;26(3):363-367.

Lerer RJ, Lerer MP. Response of adolescents with minimal brain dysfunction to methylphenidate.Journal of Learning Disabilities 1977;10(4):35-40.

MacKay MC, Beck L, Taylor R. Methylphenidate for adolescents with minimal brain dysfunction.New York State Journal of Medicine (15 Feb 1973):550-554.

Pelham WE, Vodde-Hamilton M, Murphy DA, Greenstein J, Vallano G. The effects ofmethylphenidate on ADHD adolescents in recreational, peer group and classroom settings.Journal of Clinical Child Psychology 1991;20(3):293-300.

Phillips S, Soffer SL. Recent advances regarding attention deficit-hyperactivity disorder in

Page 41: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

adolescence. Current Opinion in Pediatrics 1996;8:310-318.Safer DJ, Allen RP. Stimulant drug treatment of hyperactive adolescents. Diseases of the NervousSystem 1975;36:454-457.

Varley CK. Effects of methylphenidate in adolescents with attention deficit disorder. Journal ofthe American Academy of Child Psychiatry 1983;22(4):351-354.

Wender EH. Hyperactivity in adolescence. Journal of Adolescent Health Care 1983;4:180-186.

Wender EH. Attention-deficit hyperactivity disorders in adolescence. Developmental andBehavioural Pediatrics 1995;16(3):192-195.

Yellin AM, Hopwood JH, Greenberg LM. Adults and adolescents with attention deficit disorder:clinical and behavioural responses to psychostimulants. J Clin Psychopharmocol 1982;2(2):133-136.

Page 42: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Appendix 3: Sources of Information on Efficacy of Methylphenidate with Preschoolers

Barkley RA, Karlsson J, Strzelecki E, Murphy JV. Effects of age and ritalin dosage on themother-child interactions of hyperactive children. Journal of Consulting and Clinical Psychology1984;52(5):750-758.

Barkley RA. The effects of methylphenidate on the interactions of preschool ADHD children andtheir mothers. Journal of the American Academy of Child and Adolescent Psychiatry1988;27(3):336-341.

Conners CK. Controlled trial of methylphenidate in preschool children with minimal braindysfunction. Int J Mental Health 1975;4:61-74.

Mayes SD, Crites DL, Bixler EO, Humphrey FJ, Mattison RE. Methylphenidate and ADHD:influence of age, IQ and neurodevelopmental status. Developmental Medicine and ChildNeurology 1994;36:1099-1107.

Musten LM, Firestone P, Pisterman S, Bennett S, Mercer J. Effects of methylphenidate onpreschool children with ADHD: cognitive and behavioural functions. Journal of the AmericanAcademy of Child and Adolescent Psychiatry 1997;15(10):1407-1415.

Schleifer M, Weiss G, Cohen N, Elman M, Cvejic H, Kruger E. Hyperactivity in preschoolers andthe effect of methylphenidate. American Journal of Orthopsychiatry 1975;45(1):38-50.

Page 43: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Appendix 4: Sources of Information on Efficacy of Methylphenidate with Adults

Bellak L, Black RB. Attention-deficit hyperactivity disorder in adults. Clinical Therapeutics1992;14(2):138-147.

Gualtieri CT, Ondrusek MG, Finley C. Attention deficit disorders in adults. ClinicalNeuropharmacology 1985;8(4):343-356.

Gauthier M. Stimulant medications in adults with attention deficit disorder. Canadian Journal ofPsychiatry 1984;29(5):435-440.

Mattes JA, Boswell L, Oliver H. Methylphenidate effects on symptoms of attention deficitdisorder in adults. Archives of General Psychiatry 1984;41:1059-1063.

Ratey JJ, Greenberg MS, Lindem KJ. Combination of treatments for attention deficit hyperactivitydisorder in adults. The Journal of Nervous and Mental Disease 1991;179(11):699-701.

Shaffer D, ed. Attention deficit hyperactivity disorder in adults. Editorial. The American Journalof Psychiatry 1994;151(5):633-638.

Spencer T, Wilens T, Biederman J, Faraone SV, Ablon S, Lapey K. A double-blind, crossovercomparison of methylphenidate and placebo in adults with childhood-onset attention-deficithyperactivity disorder. Archives of General Psychiatry 1995;52:434-443.

Wender PH, Reimherr FW, Wood DR. Attention deficit disorder (>minimal brain dysfunction=) inadults: a replication study of diagnosis and drug treatment. Archives of General Psychiatry1981;38:449-456.

Wender PH, Reimherr FW, Wood D, Ward M. A controlled study of methylphenidate in thetreatment of attention deficit disorder, residual type, in adults. American Journal of Psychiatry1985;142(5):547-552.

Wilens TE, Biederman J, Spencer TJ, Prince J. Pharmacotherapy of adult attentiondeficit/hyperactivity disorder. Journal of Clinical Psychopharmacology 1995;15(4):270-279.

Wood DR, Reimherr FW, Wender PH, Johnson GE. Diagnosis and treatment of minimal braindysfunction in adults: a preliminary report. Archives of General Psychiatry 1976;33:1453-1460.

Yellin AM, Hopwood JH, Greenberg LM. Adults and adolescents with attention deficit disorder:clinical and behavioural responses to psychostimulants. J Clin Psychopharmacol 1982;2(2):133-136.

Page 44: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Appendix 5: ADHD Practice Parameters and Guidelines

American Academy of Child and Adolescent Psychiatry. Practice parameters for the assessmentand treatment of children, adolescents and adults with attention-deficit/hyperactivity disorder.Journal of the American Academy of Child and Adolescent Psychiatry 1997;36(10Supplement):85S-121S.

Carrey NJ, Wiggins DM, Milin RP. Pharmacological treatment of psychiatric disorders in childrenand adolescents: focus on guidelines for the primary care practitioner. Drugs 1996;51(5):750-759.

Committee on Children with Disabilities and Committee on Drugs. Medication for children withattentional disorders. Pediatrics 1996;98(2):301-304.

DuPaul GH, Barkley BA. Medication therapy. In: Barkley RA (ed.), Attention-DeficitHyperactivity Disorder: A Handbook for Diagnosis and Treatment. New York: Guildford Press,1990.

Elia J. Drug treatment for hyperactive children: therapeutic guidelines. Drugs 1993;46(5):862-871.

Greenhill LL. Attention-deficit hyperactivity disorder. Pediatric psychopharmacology1995;4(1):123-169.

Mental Health Committee, Canadian Pediatric Society. Hyperactivity in children. CanadianMedical Association Journal 1988;139:211-212.

Mental Health Committee, Canadian Pediatric Society. Use of methylphenidate for attentiondeficit hyperactivity disorder. Canadian Medical Association Journal 1990;142(8):817-818.

New South Wales Therapeutic Assessment Group. Treatment of Attention Deficit HyperactivityDisorder with Central Nervous System Stimulants. Position Paper. New South Wales: NSWTAG, 993.

Rapoport JL, Castellanos FX. Attention-deficit/hyperactivity disorder. In: Weiher JM (ed.),Diagnosis and Psychopharmacology of Childhood and Adolescent Disorders. 2nd ed. NewYork: Wiley, 1996.

Safer DJ. Central stimulant treatment of childhood attention deficit hyperactivity disorder: issuesand recommendations from a US perspective. CNS Drugs 1997;7(4):264-272.

Sandberg S, Day R, Trott GE. Clinical aspects. In: Sandberg S (ed.), Hyperactivity Disorders ofChildhood. Cambridge: Cambridge Univ. Press, 1996. 69-110.

Sayal K, Taylor E. Drug treatment in attention deficit disorder: a survey of professional

Page 45: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

consensus. Psychiatric Bulletin 1997;21:398-400.

Shaywitz BA, Fletcher JM, Shaywitz SE. Attention-deficit/hyperactivity disorder. In: Advances inPediatrics. 1997;44:331-367.

Weiss G. Attention deficit hyperactivity disorder. In: Lewis M (ed.), Child and AdolescentPsychiatry: A Comprehensive Textbook. 2nd ed. Baltiimore: Williams and Wilkins, 1996.

Page 46: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Appendix 6: Published Surveys of Physician Practices in Relation to ADHD

Copeland L, Wolraich M, Lindgren S, Milich R, Woolson R. Pediatricians= reported practices inthe assessment and treatment of attention deficit disorders. Developmental and BehaviouralPediatrics 1987;8(4):191-197.

Hazell PL, McDowell MJ, Walton JM. Management of children prescribed psychostimulantmedication for attention deficit hyperactivity disorder in the Hunter region of NSW. MJA1996;165:477-480.

Kwasman A, Tinsley BJ, Lepper HS. Pediatricians= knowledge and attitudes concerning diagnosisand treatment of attention deficit and hyperactivity disorders. Archives of Pediatric andAdolescent Medicine 1995;149:1211-1216.

Moser SE, Kallail KJ. Attention-deficit hyperactivity disorder: management by family physicians.Archives of Family Medicine 1995;4:241-244.

Ruel J-M, Hickey CP. Are too many children being treated with methylphenidate? CanadianJournal of Psychiatry 1992;37(8):570-572.

Wolraich M, Lindgren S, Stromquist A, Milich R, Davis C, Watson D. Stimulant medication useby primary care physicians in the treatment of attention deficit hyperactivity disorder. Pediatrics1990;86(1):95-101.

Page 47: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Appendix 7: Expert Opinion on Appropriateness of Methylphenidate Prescription

Diller LH. The run on ritalin: attention deficit disorder and stimulant treatment in the 1990s.Hastings Centre Report 1996;26(2):12-18.

Garber SW, Garber MD, Spizman RF. Beyond Ritalin: Facts about Medication and OtherStrategies for Helping Children, Adolescents, and Adults with Attention Deficit Disorders. NewYork: Harper Perrenial, 1996.

Oberklaid F, Jarman FC. Paying attention to ADHD. Journal of Paediatrics and Child Health1996;32:207-208.

Safer DJ. Major treatment considerations for attention-deficit hyperactivity disorder. CurrentProblems in Pediatrics 1995;25:137-143.

Schachar R, Tannock R, Cunningham C. Treatment. In: Sandberg S (ed), Hyperactivity Disordersof Childhood. Cambridge: Cambridge UP, 1996. 433-476.

Shaywitz BA, Fletcher JM, Shaywitz SE. Attention-deficit/hyperactivity disorder. In: Advances inPaediatrics 1997;44:331-367.

Swanson JM, Lerner M, Williams L. More frequent diagnosis of attention-deficit hyperactivitydisorder. New England Journal of Medicine 1995;333(14):944.

Vimpani GV. Prescribing stimulants for disruptive behaviour disorders: sometimes against thebest interest of the child? Journal of Paediatric Child Health 1997;33:9-11.

Page 48: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

A REVIEW OF THERAPIES FOR ATTENTION DEFICIT/

HYPERACTIVITY DISORDER

Part 2: The Efficacy of Medical and Other Therapies forAttention-Deficit/Hyperactivity Disorder in Children andYouth: a Systematic Review and Meta-analysis of theClinical Evidence

Anne Klassen, D.Phil.Anton Miller, MB.ChB., FRCPC

Parminder Raina, Ph.D.Shoo K. Lee, MB.BS., Ph.D., FRCPC

Lise Olsen, BSN, MPH

Page 49: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

GLOSSARY OF ABBREVIATIONS

ACPRS Abbreviated Conners Parent Rating ScaleACTeRS ADDH Comprehensive Teachers Rating ScaleACTRS Abbreviated Conners Teacher Rating ScaleADD Attention Deficit DisorderADDH Attention Deficit Disorder with HyperactivityADHD Attention-Deficit/Hyperactivity DisorderAPA American Psychiatric AssociationASQ Abbreviated Symptom QuestionnaireCAP Child Attention Profile QuestionnaireCBT Cognitive-behavioural therapyCIJE Current Index to Journals in EducationCPRS Conners Parent Rating ScalesCTRS Conners Teacher Rating ScalesDAS Dextroamphetamine sulfateDSM III Diagnostic and Statistical Manual of Mental Disorders, version 3DSM IIIR Diagnostic and Statistical Manual of Mental Disorders, version 3, revisedDSM IV Diagnostic and Statistical Manual of Mental Disorders, version 4HSQ Home Situations QuestionnaireMPH Methylphenidate hydrochlorideRBPC Revised Behaviour Problems ChecklistSMD Standardized mean differenceSNAP Swanson, Nolan and Pelham Rating ScaleWMD Weighted mean difference

Page 50: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

1. INTRODUCTION1.1 BackgroundAttention-deficit/hyperactivity disorder (ADHD) is a frequently-made diagnosis among NorthAmerican children. Approximately 5% of school-aged children are estimated to meet thediagnostic criteria set out in the American Psychiatric Association's Diagnostic and StatisticalManual for Mental Disorders Version IV (DSM IV).1 The defining or core features of thissyndrome relate to difficulties these children have in three domains: regulating attention to meettask demands (inattention/distractibility), inhibiting impulsive responding (behaviouraldisinhibition/impulsivity) and restraining task-inappropriate motor activity (hyperactivity). RussellBarkley, a leading figure in ADHD theory and research, describes two additional features which,while not diagnostic, are felt to be central to the disorder. These are deficient rule-governedbehaviour and excessive variability of task or work performance over time.2 Limited researchevidence points to a correlation between the ADHD symptom cluster and hypoperfusion of areasof the prefrontal cortex of the brain that are characteristically associated with executive functions,such as self-regulation, organization and judgment.3 Recent studies suggest a strong geneticcomponent to ADHD.3

Affected children commonly exhibit disruptive behaviour in the classroom, underachieveacademically, and tend to have conflictual relations with family members and peers. ADHD isassociated frequently with additional neurodevelopmental or psychiatric disturbances such aslearning, anxiety and conduct disorders, but the symptoms of ADHD are likely to become theprimary focus of the North American physician=s attention because they form a salient and readilyrecognizable cluster which has received considerable publicity in the medical, educational and laymedia. Furthermore, they are amenable to a medical modality of therapy, namely the stimulantdrugs, whose effectiveness at least over the short-term, is widely-reported in primary treatmentstudies, review articles and practice guidelines published in the medical literature.4

Management strategies broadly consist of (a) medicating the child to reduce the frequency andintensity of problematic behaviours and to allow the child to achieve better self-control and betterregulation of attention to task; (b) educating parents and teachers about the nature of ADHDthereby allowing them to have realistic expectations of the child, providing them with simplestrategies to modify the child's environment to reduce behaviour problems, and training them toacquire effective behaviour management skills; and (c) using psychological therapy with the childto teach him/her self-control and self-monitoring skills. Other modalities of therapy may also beapplied depending on individual circumstances and needs, such as social skills training andacademic tutoring.

The stimulant class of medications, comprising methylphenidate hydrochloride ("MPH", brandname Ritalin), dextroamphetamine sulphate ("DAS", brand name Dexedrine) and magnesiumpemoline (brand name Cylert) are the most widely used form of medical management. Thesedrugs act in the brain by increasing levels of catecholamines (dopamine, norepinephrine andserotonin) at the presynaptic cleft. MPH is the most frequently used agent. This drug is beingprescribed to ever increasing numbers of children (described and discussed in Part 1 of thispresent series of reports) and there are concerns among provincial payers about whether it is

Page 51: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

being prescribed in an appropriate way both clinically and economically with reference to otherstimulant drugs. There is also interest in whether alternatives to drug therapy are effective andbeing used appropriately. In this section of the report, we describe a systematic review and meta-analysis of the evidence for the efficacy of the three stimulant drugs, as well as the three mainmanagement strategies that clinicians may adopt in managing a child with ADHD: use ofmedication(s) alone, use of psychological/behavioural interventions alone, or a combination ofthese two modalities. An important purpose of the present review and meta-analysis was to obtaindata that could be used in an economic evaluation of these various treatment strategies. Our cost-effectiveness analysis, based on a decision analysis model which considers the options of notherapy, medical therapy alone, psychological/behavioural interventions alone, or a combination ofthese two modalities, is reported in a subsequent section of the present series of reports (Part 3).

Children and youth with ADHD may present to health professionals with concerns about non-compliant or disruptive behaviour at home or school, aggressive or other socially deviantbehaviours, academic underachievement or school failure, or social-emotional issues secondary topoor self-esteem. One thing they have in common is the combination of core ADHD symptomsthat make up the syndrome. Ideally, a systematic review of treatment efficacy in ADHD wouldconsider outcomes that relate to the whole array of problems with which these children present,including behavioural, academic and social-emotional. In the present study, however, the decisionwas made to focus on behavioural outcomes. The decision addressed a logistical need to keepthe scope of the study manageable while recognizing the primacy of behavioural dysfunction inADHD. A behavioural substrate, broadly defined to include attentional and self-regulatoryfunctions, presumably underlies much of the impairment that children with ADHD experienceacross clinical presentations. Such a substrate presumably also accounts for a significant degreeof the improvement that they might experience across outcome categories, as a result oftreatment.

We looked therefore for a primary measure of treatment effect that would reflect behaviours thatare observable in naturalistic contexts, that include the cluster of core ADHD symptoms, as wellas associated behaviours such as deficient rule-governed behaviour and inconsistency in taskperformance over time. Behaviour rating scales and checklists completed by teachers and parentsare widely-used and of established value both clinically to aid in diagnosis and monitor treatmenteffects, and in research applications with ADHD children.2,5,6 We reviewed the characteristics ofthe many behaviour rating scales in current use and scanned a sample of treatment studies in theinvestigators= possession to get an idea of their relative frequency of use. We found that theHyperactivity Index (HI) of the Conners Teacher Rating Scale (CTRS) and Conners ParentRating Scale (CPRS), also known as the Abbreviated Symptom Questionnaire ASQ)7 orAbbreviated Conners Teacher/Parent Rating Scales (ACTRS and ACPRS respectively) had beenwidely-used in treatment studies and came close to meeting our need for a measure whichincluded both core and associated features of children with ADHD.

The HI/ASQ represents a good measure of overall psychopathology for children presenting withADHD.7 It consists of ten items derived from factor analysis of the longer original and revisedConners Teacher and Conners Parent Rating Scales,8,9 that are most frequently checked by

Page 52: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

parents and teachers as characteristic of hyperactive children and which have been found to besensitive indicators of medication effects.10,11 Five of the items relate to core ADHD symptoms(inattention/distractibility, hyperactivity and impulsivity) and five to commonly (though notuniversally associated) characteristics which contribute to the social and academic adjustmentproblems these children experience, including disruptive and destructive behaviour, inconsistency,low frustration tolerance and emotional lability. The longer versions of Conners Rating Scales aswell as the abbreviated versions have been thoroughly researched, validated and standardized, andvery widely used to assess treatment effects in ADHD.2 Normative data are available. TheHI/ASQ is loaded with the more disruptive symptoms of ADHD for which parents and teachersare likely to be seeking help.

Having decided to focus on a single outcome measure in the present study in the interests ofparsimony and to reduce heterogeneity between, and increase comparability across, studies, theHI/ASQ was judged by the investigators to be the most relevant and appropriate single measure. Some primacy was given to the teacher-completed version for two reasons. First, a preliminaryreview of treatment studies showed the Teacher scale to be the more widely used. Second, in asignificant proportion of cases, children with ADHD receive medical therapy for classroom-related behaviour problems, and they receive it only at school. In this situation, where effects onbehaviour are predominantly occurring at school, we need teachers= observations of behaviour. However, we planned also to include the parent version, when it had been used in order to extendthe range of analyses possible. Also, we created a short list of other behaviour rating scales thatwere similar in scope and psychometric properties to the HI/ASQ.

The decision to use behavioural rating scales as the sole category of outcome measure involved arestriction on what could be concluded about the efficacy of interventions for ADHD. The factthat the ASQ represents a Amix@ of common, problematic ADHD behaviours is at once anadvantage and disadvantage of this measure. Not all children with ADHD have all thecharacteristics covered in the ASQ, particularly those ADHD subgroups which were defined inthe most recent fourth version of the DSM (DSM IV). Furthermore, the ASQ is most widelyappreciated for its sensitivity to drug effects, and sensitivity to non-drug interventions is less welldescribed. However, it seems reasonable to expect that teachers and parents would seek changesin the kinds of behaviours and characteristics covered by the ASQ, irrespective of treatmentmodality.

1.2 Objective The objective of this study was to obtain estimates of the relative efficacy of various treatmentstrategies for ADHD in children (age < 18 years) as demonstrated by differences in scoresbetween treatment groups on commonly-used behavioural rating scales, such as the ConnersAbbreviated Symptom Questionnaires or related measures. These estimates would then be usedto conduct an economic analysis to compare the cost-effectiveness of these strategies. To obtainestimates of treatment efficacy, we aimed to conduct a qualitative systematic review of theevidence from treatment studies of ADHD, followed by a meta-analysis of treatment effects.

2. METHODS

Page 53: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

2.1 Obtaining Clinical Evidence2.1.1 Sources of clinical evidenceEvidence was sought among research studies published in peer reviewed journals, from drugmanufacturers, the Cochrane library, and through handsearching of reference lists. Drugmanufacturers were requested to provide published and unpublished studies available to them. Apart from this, no attempt was made to secure unpublished studies. Studies were limited tothose produced in 1981 or later in order to coincide with the adoption of more detailed andstringent diagnostic criteria for children previously labeled as hyperactive or with hyperkineticdisorder, subsumed after 1980 into the category ADD and ADDH by the American PsychiatricAssociation's Diagnostic and Statistical Manual Edition 3, and subject to continued reformulationsin subsequent versions. We also recognized the existence of three meta-analytic studies of drugtreatment effectiveness for ADD/hyperactivity, published in the early 1980s,12,13,14 that hadanalyzed studies from the pre-1980 era. A formal appraisal of the quality of these meta-analyticreviews was carried out by two reviewers using the evaluative method described by Oxman andGuyatt.15,16 The reviews by Kavale12 and Ottenbacher13 were found by these stringent criteria tohave >major flaws= and the review by Thurber14 to have >major-to-extensive flaws=. Nonetheless,all three showed a great deal of consistency in their main findings.

2.1.2 Published literature search strategySearches were conducted on the following electronic databases during August of 1997:

Medline (1981 - present)Current Contents (1995 - present)Healthstar (1981 - present)PsycInfo (1981 - present)First Search (Article First) (1990-Present)CIJE (Current Index to Journals in Education) (1981 - present)Embase (1988 - 1997) (Search conducted October, 1997)

The overall search strategy was aimed at selecting all studies of drug and non-drugtreatment efficacy for ADD/ADDH/ADHD across all age groups. The search strategyincluded controlled, uncontrolled, randomized and non-randomized studies. This initialsearch also identified background, review and meta-analytic articles regarding treatmenteffectiveness. Search terms included: Aattention deficit disorder@, Aattention deficitdisorder with hyperactivity@, "attention-deficit/hyperactivity disorder", "hyperkineticdisorder" and "hyperkinesis". Search terms for drug treatment interventions included:"methylphenidate", "dextroamphetamine", "pemoline", "central nervous systemstimulants", "psychostimulants", and the brand names "Ritalin", "Dexedrine" and"Cylert". Search terms for non-drug interventions included: "counseling","psychotherapy", "cognitive therapy", "cognitive-behavioural therapy", "parenttraining", "family therapy", "family counseling", "behaviour therapy", "behaviourmodification", "biofeedback", "neurofeedback" and "relaxation therapy".

Page 54: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

2.1.3

Handsearching proceduresAdditionally, ten bibliographic lists were identified as Akey@ sources to be handsearched foradditional references based on their position as up-to-date (1995 or more recent) anddefinitive chapters in textbooks of child and adolescent psychiatry, pediatrics and ADHDor reviews of ADHD and its treatment. These sources are listed in Appendix 1.

2.1.4 Accessing additional sources of evidenceContact was made with the Coordinator of the Canadian Cochrane Centre in September1997. We were informed that there were no completed reviews on the topic of effectivenessof treatment for attention deficit disorder in the Cochrane Database of Systematic Reviews,nor were any such reviews in progress. Requests for data were also made to the followingdrug manufacturers: Novartis (Ritalin), SmithKline Beecham (Dexedrine) and Abbott(Cylert). A number of articles published in the medical literature were supplied from theirfiles.

2.2 Creation of Database of Intervention EffectsAn important consideration in creating a database of intervention effects was the need forthe database to be suitable for meta-analysis and subsequently for use in an economicevaluation of treatment options in ADHD. Because multiple sources of heterogeneityamong patients, treatments and outcomes in published studies of ADHD pose significantchallenges to interpreting research findings in this area,17,18 we adopted as a priority theneed to minimize sources of heterogeneity between studies and subjects as far as possible. One of the ways to achieve this goal was to extract data derived from a single outcomemeasure. As previously described, the Abbreviated Conners Teacher and Parent RatingScales were the instruments chosen. However, in order to avoid a potential situation ofhaving too few data to analyze, data were also extracted on a limited number of otherbehavioural measures.

Steps involved in the creation of the database were: (1) identification of potentially relevantstudies from initial search titles and abstracts based on their appearing to satisfy theeligibility criteria described in Section 2.2.1, and retrieval of articles using the followingdecision rule: if the paper definitely or possibly was eligible, it was retrieved; if it definitelywas not eligible, such as a case report or review article, it was not retrieved. This step wasconducted by a Masters-level research associate, who served as Project Coordinator (LO),in close collaboration around all doubtful items with the principal investigator of theoverall project (AM); (2) detailed review of retrieved studies for eligibility using apredetermined set of criteria (see below); This step was performed twice - initially for thepreparation of the first draft of this report, and a second time following external reviews ofthe first draft, in order to collect more detailed information on the ineligible studies. By theend of the second round, the vast majority of studies had been reviewed by two different

Page 55: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

reviewers from a group of four who were Masters or Doctoral-level research associates,using protocols and forms developed for this study. Resolution of uncertainties wasachieved through close consultation with the project principal investigator. For studiesthat met eligibility criteria, the reviewers proceeded to step (3) namely evaluation of studyvalidity and step (4) data extraction. In order to assess the reliability of the qualityevaluation and data extraction processes, ten studies (39%) were reviewed by more thanone reviewer. Six were reviewed by two reviewers and four by all three reviewers. Intra-class correlation coefficients were computed to assess the interrater agreement for thevalidity scores. Kappa statistics were computed to assess agreement on certain descriptivecategorical data.

2.2.1 Evaluation of eligibilityRetrieved studies were evaluated for eligibility against the criteria in Table 1. Theseeligibility criteria reflect the need to reduce heterogeneity described above, and the aim tomake the treatment efficacy evaluation as ecologically relevant as possible. Hence theemphasis on studies of children who are broadly representative of the general population ofchildren with ADHD (rather than diagnostic subgroups) and who are treated andmonitored for effects in naturalistic settings, such as home and school rather than inlaboratory-based settings. The rationale for restriction of eligible outcomes to rating scalemeasures of the common behavioural features of ADHD is presented in Section 1.1 above.

2.2.2 Study quality evaluation proceduresThe methodological quality assessment scale developed by Detsky et al.19 was modified tomeet the needs and objectives of the present review. The resulting 18-item form assessedhow studies performed and reported in six key areas: randomization procedures; inclusionand exclusion of participants; descriptions of treatments provided; measurement ofoutcomes; methods of data analysis; and closeness of the aim of the study to the purposes ofthe current review. To provide the reviewers with operational definitions for the responsecategories of the validity form, but not to be used as an evaluative tool itself, a further formwas developed based on Chalmers= collation of guidelines for assessing the quality of arandomized control trial,20 and tailored to reflect the quality criteria assessed in this study. (Forms available from the authors on request). The validity form provided a scoringsystem to generate a total quality score for each study that could range from 0 to either 34or 36, depending on the response to one item, and that was then converted to a percentage. The quality score was used in this meta-analysis in two ways: (1) at the data analysis stageto examine whether findings of treatment efficacy were affected by quality of primarystudies; and (2) to explore the relationship between quality of primary studies andvariables such as study design, year of publication and treatment type.

Inter-reviewer reliability for the validity form was expressed by an intraclass correlationcoefficient (rho) of 0.43 for 10 studies where ratings were made by two reviewers, and 0.79for four studies where ratings were made by three different reviewers. There was a highdegree of agreement on most but not all items. There was perfect agreement between the

Page 56: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

two reviewers who evaluated the 10 studies on five items, one instance of disagreement onfive items, two instances of disagreement on three items, three instances of disagreement onfour items and eight instances of disagreement on one item. This latter item askedADescription of randomization -- adequate, partial or inadequate.@ However, deleting thisitem from the analysis did not appreciably change the intraclass correlation coefficient.

2.2.3 Data extraction proceduresA data extraction form (available from author) was created to describe backgroundinformation on the characteristics of individual studies, and to capture data on the effectsof various treatments. The data extraction form consisted of 6 key areas: (1) studycharacteristics, such as design; (2) subject characteristics, such as age and gender studiedand diagnostic characteristics; (3) intervention characteristics, such as details of the type ofthe treatment used; (4) study findings, in terms of the results reported on main behaviourrating scales; (5) subject attrition from the study, with reasons; and (6) adverse reactions totreatment.Reliability of data extraction between reviewers was ascertained by finding high degrees ofconcordance (k = 0.8 to 1.0) on most items and moderate concordance (down to k = .5) on afew items, such as coding of specific diagnostic groups (i.e. disagreements about whethersubjects should be coded as >ADDH (DSM III)= vs. >ADD/ADDH/ADHD C not furtherspecified=) and the number of comorbidities present in a study sample. In cases ofdisagreement between data extracted by the two reviewers, a further reviewer went back tothe original article to resolve the difference. In addition, as a quality control measure, allextracted data for the principal dependent variable (i.e. scores from rating scales) werechecked against the original study at the time of their entry to the database.

Treatment studies in ADHD employ varied and often multiple outcome measures, but wehad predetermined to evaluate the effects of treatment on the commonly problematicADHD behaviours as exemplified by the HI/ASQ. Because we did not want to excludestudies that used an outcome measure that may have been functionally similar or evenequivalent to the HI/ASQ, the commonly-used teacher and parent-completed behaviourrating scales were organized hierarchically into an algorithmic chart. The hierarchicallisting was established by the investigators, based on scanning the individual instrumentsand determining their closeness in content and purpose to the HI/ASQ. The algorithmicchart is reproduced in Appendix 2. If the study had not used the Abbreviated ConnersScales (or Hyperactivity Index), reviewers were guided to extract data from the IOWAConners Teacher or Parent Rating Scales (IOWA CTRS and IOWA CPRS, respectively),21

followed by the Attentional Problems subscale on the Achenbach Child BehaviourChecklist B Teacher Report Form (CBCL-TRF),22 the Child Attention ProfileQuestionnaire (CAP),23 Revised Behaviour Problems Checklist (RBPC),24,25 ADD-HComprehensive Teacher Rating Scale (ACTeRS),26 the Home Situations Questionnaire(HSQ),27 and various other instruments that were not finally used.

The utility, standardization, psychometric properties, and validity of these instrumentshave been reported and reviewed.2,5,6,28 The Conners Scales, HSQ, CAP Questionnaire, and

Page 57: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

ACTeRS have all been found to be sensitive to treatment effects.2 The RBPC showsconvergent validity with other instruments.6 The Abbreviated Conners Scales, IOWAConners Scales and RBPC include a mixed group of core ADHD symptoms along withaggressive and disruptive behaviours, emotional lability, etc. The ACTeRS (Attention andHyperactivity subscales), CAP Questionnaire and HSQ have a somewhat narrower focuson core symptoms.

2.3 Data Management and AnalysisSPSS for Windows was used to enter and analyze the validity data and the backgroundcharacteristics. Meta-analytic procedures were conducted using RevMan software. RevMan software was developed by the Cochrane Collaboration for the synthesis of studydata in systematic reviews.

The studies to be analyzed varied on: (1) specific stimulant drug used; (2) whether dosagewas expressed in absolute terms i.e. total mg. of drug, or alternatively in relation to bodyweight i.e. in mg/kg; and (3) whether a single or alternatively multiple dose levels had beenused and reported. To be able to utilize as much available data as possible, three decisionswere made. First, that stimulant drugs would be analyzed both as individual agents (i.e.MPH, DAS and pemoline separately) as well as collectively under the heading of Astimulantdrugs@. This approach seemed reasonable given that (a) many authoritative reviews ofpharmacotherapy of ADHD consider these three drugs as a common class of medicationwith very similar effects; (b) previous overviews/meta-analyses of stimulant effects haveexamined the stimulants in this way, and have not found major differences in effects,12,13

and (c) it was the most appropriate way to compare one class of treatment (stimulantdrugs) with another class of treatment (psychological/behavioural therapies). Second, toadopt mg/kg as the standardized unit of expressing dose levels. When the primary studyhad not used this unit of measurement, it had to be calculated from the absolute doses thatwere used. This was done using the average weight of children in the study, whenprovided. When not provided, we estimated the average weight from information on theaverage age of children in the study and the proportion of males, based on normativeinformation on weights of boys and girls of various ages supplied by the National Centerfor Health Statistics. Third, to keep the scope of the analyses manageable, that we wouldanalyze drug effects for a single dose level only from each study. This necessitated selectinga particular dose level in studies that reported effects of multiple dose levels. Weacknowledge that this decision precludes examination of dose-response relationships, whichmay be important if the effect of stimulants are not linear with dose level. However, thedose-response relationships reported among groups of ADHD children treated withstimulants most frequently have been linear in nature.29 Furthermore, by adopting astrategy to select the most commonly-used dose, we would analyze effects that have the mostreal-world relevance. To achieve this, we examined the dose levels used in the single dosestudies and computed the average dose level used across these studies. This value was thenused as a guide for choosing outcome data from the multiple dose studies. Outcome datawere extracted for the medication condition closest to the average drug dose from the singledose studies.

Page 58: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Data were extracted from studies for one teacher and one parent rating scale. If outcome data formore than one scale were given in the report, only one of each was extracted using thealgorithmic guidelines described above. Before combining the data, we ensured that the datapresented in the individual studies were in comparable units of measurement. With one exception,all the instruments used to assess outcome are scored on scales where low scores indicate betterfunction. For this instrument, negative signs were added to the scores on the ACTeRS measureto make them consistent with those scored in the reverse direction, enabling us to include thesedata in the meta-analysis.

Although the Parent/Teacher ASQ and the Hyperactivity Index of the CTRS and CPRS arefunctionally identical,30 scores may sometimes be expressed as total scores or as average scoresper item, thereby differing by a factor of ten. Prior to data combining, these inconsistencies werecorrected by multiplying by ten when indicated. One study required the ACPRS scores to beanalyzed in terms of T-scores.

Four instruments, the IOWA Conners Teacher Rating Scale (IOWA CTRS), IOWA ConnersParent Rating Scale (IOWA CPRS), Child Attention Profile (CAP) and the ADDHComprehensive Teacher's Rating Scale (ACTeRS) provide separate scores for different subscales. The IOWA CTRS and CPRS are composed of two subscales, Inattentive/Overactive andAggressive. The CAP is composed of two subscales, Inattention and Overactivity. The ACTeRSis composed of four subscales, Attention, Hyperactivity, Social Skills and OppositionalBehaviour. The subscale scores for the IOWA Scales and the CAP can be summed to produce atotal overall score since the items that compose each scale do not overlap. Where studiespresented results as subscale scores rather than total scores on these instruments, we summed themean score for each subscale and pooled the standard deviations for purposes of the meta-analysis. It is not appropriate however to produce a total score from the subscale scores of theACTeRS, so where subscale scores were reported for this instrument, we elected to use theAttention subscale score in the analysis.

In situations where results were presented by mutually exclusive subgroups (such as low, average,and high-weight subjects) rather than for the sample as a whole, it seemed reasonable to pool thedata and report an overall sample mean and standard deviation.

Since some studies reported on outcomes from more than one point of time, the decision wasmade to analyze data from the first post-treatment assessment, and to perform a sensitivityanalysis on the follow-up data to assess any change in efficacy over time.

Since the data extracted from the studies were continuous and different outcome instrumentswere used, weighted mean differences (WMD) and standardized mean differences (SMD) werethe summary statistics used for the meta-analysis. The WMD were used for combining resultsacross studies that used the same outcome measure. The SMD were used when differentoutcome measures had been employed across studies, since data for these were in different units.

Page 59: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

The SMD, also called the effect size, is obtained by dividing the difference between the mean inthe treatment group and the mean in the control group by the standard deviation in the controlgroup.

RevMan can by used to test the heterogeneity of study results for each table of comparisons, toassess whether the results of different studies are similar (homogeneous). However, since tests ofheterogeneity are highly conservative, and heterogeneity can exist even when a hypothesis forheterogeneity is rejected,31 and the trials included in this review differed across a range ofvariables e.g. intervention, drug dose, timing of follow-up, outcome measures, sample size etc.,we assumed that there was heterogeneity of treatment effect across the studies in each meta-analysis and chose the random effects model.

The meta-analysis method used was that of DerSimonian and Laird.32 Since only studies thatsupplied outcome data were included in the analyses, there were no missing data in the review.Our intention was to combine data from cross-over trials with data from parallel group studies inthese analyses, if necessary. Meta-analyses were performed separately for the teacher and parentrating scales.

Page 60: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

3. RESULTS3.1 Search FindingsThe initial search of the electronic databases yielded over 1000 citations. Table 2 shows the totalnumber of citations identified through the various electronic databases. Since there was someduplication of studies across databases, the total number of discrete studies to be reviewed waslower than the sum of the individual database totals. No unpublished studies data were obtained.

Citations and abstracts were examined and potentially eligible articles were retrieved. These werereviewed along with studies identified through handsearching (n = 25), papers made available bypharmaceutical companies and other contacts, and papers already in the investigator's possession. A total of 195 treatment studies were examined in detail according to the two-stage proceduredescribed in Section 2.2. These studies are listed in Appendix 3. Of these, 26 studies (listed inAppendix 4) met the inclusion criteria set out in Table 1. The findings from these studies formedthe database of intervention effects. Details about the studies deemed ineligible under individualcriterion categories are presented in Table 3. Forty-six studies were excluded because they werenot designed as randomized clinical trials. No further checking for eligibility was done with these. Of the remaining 123, it will be noted in Table 3 that fairly frequently individual studies failed tomeet more than one eligibility criterion.1

3.2 Characteristics of Studies in the Database of Intervention Effects3.2.1. GeneralThe salient characteristics of each of the 26 treatment studies including their methodologicalquality scores are given in Table 4. Further details about the intervention(s) in the 21 drug studiesare provided in Table 5, for the two psychological/behavioural studies in Table 6 and for the threecombination studies in Table 7. There are a number of important observations to be made aboutthe database of intervention effects at the outset. First, these 26 studies represent only a smallproportion of all studies reviewed, and include very few studies of psychological/ behavioural andcombined treatment modalities. Second, among the small group of five studies (Tables 6 and 7)there was considerable diversity in the specific interventions used and in the selection andmanagement of control groups. A "package" of therapeutic interventions (apart from drugtherapy) could, however, be discerned, consisting of: (1) individual psychological therapy with thechild, usually cognitive or cognitive-behavioural therapy (CBT); (2) some parent training inapplication of CBT principles at home as well as in behaviour management; and (3) provision of ateacher-training component in some cases as well. Though this "package" was not applieduniformly across studies analyzed, it provided the basis for calculations to be used in thesubsequent section of the paper to do with economic evaluation. Third, across studies there wasonly limited uniformity among outcome measures used. This further limited the number of studieswhere effects could be directly compared. Below we describe in some detail the characteristics ofthe individual studies.

3.2.2 Quality scoresExpressed as a percentage of maximum quality, these ranged from 38 to 94, with a mean score of75 and s.d. of 14, indicating that while methodological quality of studies in the efficacy database

1 Details about the exclusion of individual studies may be obtained from the authors on request.

Page 61: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

was reasonably high, it was variable. Quality scores of individual studies are presented in Table 4. To investigate the possible impact of quality differences on study results (i.e. the overalllikelihood of a study=s finding of treatment efficacy), the six studies of highest quality werecompared with the six studies with the lowest quality scores. No overall differences in efficacywere found (details reported under section 3.3.1.1). To investigate whether the quality of arandomized controlled trial was related to other factors, comparisons were made between validityscore and a number of variables. There was no difference in the mean validity score and studydesign (parallel vs. within study design); type of study (drug vs. psychological/behavioural andcombination study) nor was there any correlation with sample size. There was a strongcorrelation (r = .53, p = .005) between validity score and year of publication, with qualityimproving steadily over time.

3.2.3 Study characteristics A within-subject crossover design was used in 19 studies, all of them drug treatment studies. Abetween-subjects parallel design was used in seven studies (two drug studies and five non-drug orcombination type). We decided to combine data from the two parallel group design studies withthe other drug studies that employed a crossover design in view of the following: (1) excludingthem had very little impact on the results; and (2) there is no consensus on the legitimacy orotherwise on combining data from these two kinds of study designs.

3.2.4 Subject characteristics In the majority of cases (20 out of 23 studies reporting this aspect) subject recruitment was fromchildren referred to a clinic or clinic-based research program. Twenty-four of 26 samplesconsisted of school-aged children, and, as seen in Table 4, subjects were mostly males. In all 26studies, subjects were described as having ADD, ADDH or ADHD. In 22 studies, it was explicitthat they fulfilled DSM III (n = 14) or DSM-IIIR (n = 8) criteria for one of these diagnoses. In afurther four studies, the diagnosis appeared to have been made using a combination of clinicalevaluation and other criteria, such as exceeding cutoff scores on various behaviour ratinginstruments. Twenty-two studies used more than one standardized criterion for diagnosingsubjects as ADD/ADHD. Sample sizes (defined by subjects completing the study) varied from 9to 161. The mean sample size was 38 (s.d = 31) and the total sample size was 999. Elevenstudies reported the presence of comorbidities in their subjects. The most frequent of these wereConduct Disorder (nine studies) and Oppositional Defiant Disorder (seven studies).

A reason for attrition from the study was mentioned in ten of the 26 studies. The percentage ofparticipants reported as lost from these studies ranged from 4% to 78%, with a mean of 21.7%calculated from the percentage reported in individual studies. A variety of reasons were given forattrition.

3.2.5 Intervention characteristicsCertain studies (1,7 and 24) reported on efficacy of DAS relative to placebo and to other agents. We extracted only those data relevant to contrast of DAS against placebo. In addition, one study(study 14) measured the efficacy of sustained release MPH, standard MPH and a combination ofMPH sustained release and standard MPH. We chose to focus on the standard rather than

Page 62: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

sustained release MPH treatment. In one study (study 10), one of nine subjects in the studysample was administered pemoline because he had previously been non-responsive to MPH; therest of the sample were given MPH. This study was analyzed as a study of the efficacy of MPH. In total, 24 studies involved the use of medication: one studied the efficacy of pemoline, fourstudied Dextroamphetamine, and 19 studied MPH.

Thirteen studies measured the efficacy of a single dose of stimulant drug (nine MPH and fourDAS), while the remaining 11 (ten MPH and one pemoline) examined the effects of differentdoses. The mean daily MPH dose from single dose studies was calculated to be .7 mg/kg, and theresults from the MPH dose-response studies closest to this dosing level were used. In thepemoline dose-response study, data were reported for doses of 18.75 mg, 37.5 mg, 75 mg and112.5 mg of pemoline. It has been reported that 10 mg of MPH given b.i.d produces equivalentbehavioural effects to a dose of pemoline of about 58 mg.33,34,35 Since 10 mg of MPH given twicea day to a nine year-old, 28-kg child is roughly equivalent to .7 mg/kg/day, the closest equivalentdose for pemoline is 58 mg. The Amost equivalent dose@ for pemoline to the MPH dose we werestudying was therefore intermediate between the 75 mg and 37.5 mg dosing levels reported in thestudy of pemoline effects. Hence analyses for pemoline effects were run using dosing levels bothat one level above and one below the ideal equivalent dose of 58 mg.

In five studies, dosages were specified in mg. and these had to be converted to mg/kg dose levels. The doses specified in Tables 5 and 7 are the daily dose levels extracted from each study whichinvolved administration of medication and outcomes data corresponding to these levels were usedin the meta-analysis.

The occurrence of adverse reactions to MPH that resulted in subjects dropping out of the studywas reported in two studies. In one (study 21), these side effects were cited as the reason for fivesubjects= discontinuing MPH. In the other study (study 22) adverse effects led to one childterminating the study prematurely.

3.2.6 Outcome characteristicsData were extracted for both a teacher and parent scale from 13 studies, for a teacher rating scalealone in ten, and for a parent rating scale alone in three studies. Twenty-three studies reportedresults from teachers= scales, and five different teacher instruments were used. Fifteen studiesreported results from parents= scales, and four different parent rating scales were used. The mostcommonly used teacher and parent measures were the respective versions of the AbbreviatedConners Rating Scale (ACPRS/ACTRS/ASQ/HI). Tables 8 and 9 list the teacher and parentinstruments used in the 26 studies broken down by type of study and number of times eachinstrument was used.

Four drug studies (8, 15, 16 and 19) presented outcome data for subgroups of children in thosesamples individually. The data from these subgroups were combined in the manner described inSection 2.3.

For the drug studies the post-treatment assessment took place at 7 to 25 days following the onset

Page 63: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

of the intervention. Overall, the time to follow-up was less than two weeks after commencementof intervention. This would be considered a short period of time compared with most clinicaltrials, but given the rapid action of the stimulant drugs, it is adequate to observe important andconsistent changes in behaviour. One drug study (study 21) conducted a post-treatment andfollow-up assessment. The five psychological/behavioural and combination studies conductedboth a post-treatment and follow-up assessment. The post-treatment follow-up took place onaverage 91 days after treatment had commenced (range 70 - 120), and the follow-up averaged195 days after treatment (range 112 - 365). One study (study 12) included further follow-up, 24month after treatment. Tables 5 to 7 contain information about the length of time from baselineto follow-up for the 26 studies.

3.3 Estimation of Treatment Efficacy3.3.1 Efficacy of drug treatment alone3.3.1.1 Drug vs. placebo contrastsSignificant treatment effects attributable to drugs were found across drugs and outcomemeasures.

Teacher rating scales. Eighteen trials provided data about the efficacy of drug treatmentmeasured in terms of a teacher rating scale. In the first analysis, the low dose level for pemolinewas used (see Section 3.2.5). In three trials, the treatment was no more effective than placebo. However, when the data from all studies were combined using a random effects model, the pointestimate and 95% confidence intervals for a standardized mean difference, revealed that drugtreatment was more effective than placebo (SMD = -1.028; 95% CI = -1.212, -0.843 Z = 10.92)(Fig 1). Subsequent analysis showed these effects to be independent of the methodologicalquality of the studies analyzed. When the six studies with the highest quality scores (mean qualityscore 89.5) were compared with the six lowest scoring studies (mean quality score 65), the effectsizes were SMD = -1.02 (95% CI = -1.385, -0.654) and -1.122 (95% CI = -1.357, -0.887)respectively.

In the second analysis, the high dose level for pemoline was used. Under these conditions,treatment was found to be no more effective than placebo in two studies and after combing datafrom all studies, a significant effect for drug over placebo was found (SMD = -1.065; 95% CI = -1.243, -0.886, Z = 11.72) (Fig 2).

Conners Teacher Rating Scale. Thirteen trials from the above analysis used the ACTRS tocompare drug treatment with placebo. In the first analysis, the low dose level for pemoline wasused. A weighted mean difference statistic was used, and the results indicate that drug treatmentwas more effective than placebo (WMD = -6.265; 95% CI = -7.140, -5.390; Z = 14.03). (Fig 3).

In the analysis using the high dose level for pemoline, not surprisingly a similar effect was found(WMD = -6.447; 95% CI = -7.290, -5.604,Z = 14.99) (Fig 4).Parent rating scales. Thirteen trials provided parent rating scale data which could be pooledusing a standardized mean difference. Two trials produced negative results. The combined effectsize and 95% confidence intervals indicate that treatment was more effective than placebo (SMD

Page 64: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

= -0.859; 95% CI = -1.140, -.578; Z = 5.99). (Fig 5). Conners Parent Rating Scale. Nine studies provided data for the ACPRS in the same units andcould be combined to produce a combined effect size using a weighted mean difference statistic(one trial, which presented the ACPRS results in T-scores, was not included in this analysis). Theresults indicate that drug therapy was more effective than placebo (WMD = -4.515; 95% CI = -5.790, -3.241; Z=6.95). (Fig 6).3.3.1.2 Specific drug vs. placebo contrastsBecause the pemoline and four Dextroamphetamine studies used the ACTRS, as did eight of theMPH trials, the analyses in this section have been limited to the ACTRS to increase comparability. The results are summarized in Table 10 with details below. It was not possible to analyze resultsusing parent rating scales because although 12 MPH studies included a parent outcome measure,only one trial of Dextroamphetamine did so.

MPH vs. placebo. The results for eight trials of MPH were combined. The weighted meandifference and 95% confidence intervals resulted in the following point estimate (WMD =-6.732; 95% CI = -7.576, -5.887; Z = 15.63). (Fig 7) Dextroamphetamine vs. placebo. The results of four trials of DAS were combined. The weightedmean difference for the three studies of DAS was WMD = -4.771 (95% CI = -6.431, -2.992; Z =5.37). (Fig 8)pemoline vs. placebo. The effect size for the single pemoline trial using the low dose conditionwas WMD = -4.00; 95% CI = -7.80, -.20, Z = 2.06)(Fig 9). For the high dose condition, theeffect size was markedly larger at WMD = -7.8 (95% CI = -11.239 -4.361 Z = 4.45) (Fig 10). The confidence intervals were broad for both these analyses.

3.3.2 Efficacy of psychological/behavioural treatmentsTwo studies provided data about the efficacy of psychological/behavioural treatments used alone. Significant effects were not found for such treatments analyzed as a combined "package" inrelation to controls or the comparison group.

Teacher rating scales. The pooled effect size was SMD = -0.398 (95% CI = -1. 276, 0.48; Z = .89) (Fig. 11). One study (study 11) used the parent Revised Behaviour Problems Checklist(RBPC) and showed a significant result for the treatment arm. The other study (study 3) using theACTRS, showed a non-significant effect size of WMD = 0.30 (95% CI = -4.469, 5.069; Z = .12)(Fig 12).Parent rating scale. One study used the parent RBPC. The effect was not significant (WMD = -3.800; 95% CI = -9.599, 1.999; Z = 1.28 ) (Fig 13).

3.3.3 Efficacy of combined medical and psychological/behavioural treatmentsThree studies provided data about combined modalities of treatment. The way that results werepresented in these studies permitted three kinds of comparisons to be made, which are describedin detail below but can be summarized as follows: (1) combination therapy was more efficaciousthan placebo/no treatment based on parent but not teacher ratings; (2) combination therapy wasnot more efficacious than drug therapy alone; (3) combination therapy was more efficacious thanpsychological/behavioural treatments alone based on parent but not teacher ratings.

Page 65: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

3.3.3.1 Combination therapy vs. placebo/no-treatment contrastsConners Teacher Rating Scale. Two trials measured the benefit of combination therapy versus acontrol condition group with discrepant results and no overall effect (WMD = - 3.777; 95% CI =-8.064, 0.510; Z = 1.73) (Fig. 14).Conners Parent Rating Scale. In the above two trials (Studies 5 and 6), outcomes were alsomeasured with the ACPRS. As with the teacher rating scales, the two studies showed discrepantresults, but the overall effect here was statistically significant favoring combination therapy(WMD = -7.345; 95% CI = -12.289, -2.401; Z = 2.91) (Fig. 15).

3.3.3.2 Combination therapy vs. drug-only therapy contrastsConners Teacher Rating Scale. Three studies contributed data. There was no significantdifference between combination and drug-only therapy. The pooled effect size was WMD =1.285 (95% CI = -0.717, 3.286; Z = 1.26) (Fig 16). Conners Parent Rating Scale. Two trials used the ACPRS to measure outcome. There was nosignificant difference between combination and drug-only therapy. The pooled WMD was - .460 (95% CI = -3.861, 2.942; Z = 0.26)(Fig. 17).

3.3.3.3 Combination therapy vs. psychological/behavioural treatmentsConners Teacher Rating Scale. Three studies provided data for this comparison. No significantdifferences were found between combinations of psychological/behavioural treatments withmedication (MPH) and psychological/behavioural treatments either given alone or combined witha medication placebo. The combined WMD was -2.006 (95% CI = -4.174, 0.163; Z = 1.81)(Fig18).Conners Parent Rating Scales. Two studies provided data for this comparison, both using theACPRS. A significant effect was found favoring Combination therapy, with overall WMD = -5.911 (95% CI = -8.631, -3.190; Z = 4.26)(Fig 19).

3.3.4 Relative efficacy of drug, psychological/behavioural and combined therapiesTables 11 and 12 summarize the main contrasts described above by teacher and parent measuresrespectively. Tables 13 and 14 summarize these findings by ACTRS and ACPRS respectively.Discrepancies between the statistics in these tables and those found in the individual figures aboveare because all effect sizes in these tables are expressed in the units of SMD's for consistency.

4. CONCLUSIONS4.1 Summary of Main FindingsThe results of this review and meta-analysis can be summarized as follows:

_ Findings for drug therapy (as a category of intervention) were consistent._ Drug-only therapy is efficacious in ADHD._ No clear differences in efficacy were found between the agents MPH, DAS and pemoline._ Findings for psychological/behavioural therapies and combinations of medication with

psychological/behavioural therapies were inconsistent._ Psychological/behavioural therapies used alone appeared not to be efficacious in ADHD.

Page 66: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

_ Combinations of medication with psychological/behavioural therapies were moreefficacious than various control/placebo conditions for parent but not teacher ratings ofADHD.

_ Combinations of medication with psychological/behavioural therapies were no moreefficacious than medication given alone. In other words, the addition of variouspsychological/behavioural therapies to a regimen of MPH added nothing over-and-abovethe effects of MPH alone.

_ Combinations of medication with psychological/behavioural therapies were moreefficacious than psychological/behavioural therapies used alone for parent but not teacherratings of ADHD.

_ The above findings need to be interpreted with caution for three main reasons: (1) there is a paucity of good quality experimental studies, resulting in wide confidence

intervals for the estimates of efficacy of certain treatments;(2) there is extreme heterogeneity in the literature on treatment of ADHD. Even after

taking steps to reduce this as much as possible, there remains considerableheterogeneity among the studies analyzed with respect to study quality, design, subjectcharacteristics, interventions, outcome measures and follow up. There are risks ininterpreting results from analyses which combine data from studies that are asheterogeneous as these; and

(3) the findings are limited to the effects of treatments on a particular class of outcome(i.e. observable behaviours) as captured by a narrow selection of behaviour ratingscales.

4.2 Expansion and Interpretation of Main Findings4.2.1 Drug-only studiesThe statement that drug-only therapy is efficacious in ADHD is more accurately informative whenframed in the particular context and constraints of the present review. This would then state thatmedication therapy is efficacious in reducing elevated levels of behaviours ("symptoms"), such asoveractivity, disruptive and immature behaviours, emotional lability, distractibility, impulsiveness,lack of perseverance with tasks and difficulty following directions, as measured by changes withinindividual subjects within weeks of treatment onset, and while continuing to take medication.

Our ability to make accurate comparisons of relative efficacy was limited by the paucity of dataavailable on DAS and in particular, pemoline. Analyzed pemoline effects varied widely with thedose level selected, and irrespective of dose level, confidence intervals were wide. In spite of this,however, and based on our estimation of efficacy from differences in scores on the ConnersAbbreviated Teacher Rating Scale, we can say that there appeared not to be any major differencesbetween MPH, DAS and pemoline. Previous studies comparing MPH and DAS similarly foundthat neither drug was superior to the other, and that non-responders to one of the drugs are likelyto respond to the other.36 Similarly, while their side-effect profiles are similar, some patientstolerate one agent better than the other. Hence it has been recommended that children who fail torespond or tolerate the one stimulant should be tried on the other.36 pemoline offers the advantagethat dosing is once daily, so the inconvenience of a noon dose at school is avoided. Single dailydosing also presumably improves adherence. However the use of pemoline is limited by fears of

Page 67: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

liver damage and the need to check liver enzymes periodically. Though the evidence for a causalrelationship has been challenged,37 the HPB approved product monograph states that because ofits association with life-threatening hepatic failure, it should not ordinarily be considered as first-line therapy for ADHD.

4.2.2 Psychological/behavioural therapiesThe statement that psychological/behavioural therapies used alone appeared not to be efficaciousin ADHD also needs to framed within the context and constraints of the present review. Thiswould make explicit that psychological/behavioural therapies consisting of various combinationsof CBT administered to individual children and groups and parents as individual dyads andgroups, as well as education sessions with parents and teachers when applied in parallel groupdesigns, failed to produce significant differences in ADHD symptomatology on teacher or parentmeasures between these groups. It would also emphasize that there were only two studiesanalyzed in this category, each with very small samples (n < 13 in all experimental arms), and thatthese two studies differed in their findings in that one found a significant effect of treatment whilethe other did not (Fig. 11). The two studies also differed in terms of interventions provided, theselection and management of controls and follow-up arrangements (as outlined in Table 6), aswell as in the outcome measures used.

These results need to be viewed alongside others in the published literature, which were notincluded in the efficacy database of the present study. This literature also provides mixed orconflicting evidence of the efficacy of psychological/behavioural therapies used alone. Forexample, some studies report absent or weak/variable effects due to therapies such as behaviouraltherapy, cognitive training or social skills training,38,39,40 while others have found parentmanagement training41 and comprehensive behaviour modification classrooms to be helpful.42 Arecent meta-analysis found that school-based interventions are effective in enhancing theclassroom behaviour of elementary school-aged students with ADHD, and further, as discussedbelow, that certain types of interventions were more effective than others.43

4.2.3 Combinations of drug with psychological/behavioural therapiesIt should be emphasized here that although a number of analyses were done to contrast varioustreatment conditions (e.g. Combined therapy vs. no active treatment; Combined therapy vs. Drug-only), the data used were derived from a limited pool of just three studies, all of which used smallsamples averaging about 15 subjects, and differed in terms of treatments provided,comparison/control groups used, and follow-up arrangements (summarized in Table 7). Furthermore, for many of the contrasts performed, results were discrepant between studies in thatcontrast category. When combination therapy was compared with no treatment/placebo on theConners Teacher measure, one of the studies showed a statistically significant effect and one didnot. Study 6, which showed a significant benefit to Combination therapy, used for comparison ano-treatment group recruited (non-randomly) from children previously on a waiting list at theauthors clinic. Study 5, which did not detect a difference between the treatment and control arm,used a control group which was randomly assigned and obtained a placebo drug and a placebopsychosocial therapy - the same amount of exposure to material and a therapist but noinstructions in problem-solving strategies. Sometimes when individual studies were discrepant, an

Page 68: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

overall significant effect was found (e.g. for parent measures of Combination therapy vs. notherapy/placebo), and sometimes an effect was not found (e.g. teacher measures of Combinationtherapy vs. no therapy/placebo).

Since drug therapy alone was found to be efficacious, we might expect the combination of drugtherapy plus another modality of therapy also to be efficacious compared with either notherapy/placebo or psychological/ behavioural therapies used alone. However, present resultsoffer only partial support for this expectation. There is discrepant evidence for Combinationtherapy's efficacy vs. no therapy/placebo, and only on parent measures did Combination therapyappear to be more efficacious than psychological/ behavioural therapies. Methodological factorsto do with study design (within subject designs for drug studies and parallel group designs forcombination therapies), diversity in interventions applied and control conditions used, likelyaccount for this situation, which is discussed further below. Such factors may also explain thediscrepancies to be found in the broader published literature (including studies not included in ourintervention effects database) examining the efficacy of combined modalities of therapy. Somehave demonstrated a relative benefit to combining psychological/behavioural therapies withmedication,44,45,46 while others have found no added benefit.40,47 Several experimental studiespoint to the major effect in combined interventions arising from the medical rather than thepsychological/behavioural component.46,48,49

4.3 Interpretation of Results: Caveats and LimitationsWe encountered serious difficulties in trying to compare the relative efficacy of medical,psychological/behavioural and combined forms of therapy for children and youth with ADHDusing the methods of systematic review of published evidence and meta-analysis. The considerablemethodological challenges that face investigators in this area have been reviewed by others.17,18 The most serious problem we encountered was a lack of studies providing data of adequatequality that could be used in the review and meta-analysis. This lack of data was attributable totwo main factors: (1) a relative paucity of treatment studies other than drug treatment studies. Many studies have been published on the management of hyperactive and ADHD children in thepast 25 years, but the vast majority have been studies of medication effects. Furthermore, whilethe effects of stimulant medications lend themselves well to highly controlled experimentalstudies, behavioural treatments are harder to evaluate in this way, leading to a further scarcity ofmethodologically rigorous data; and (2) heterogeneity of various kinds that exist in relation toADHD and its treatment. In attempting to reconcile the needs of the present study with therealities imposed by the co-existence of these two factors, we strove continually for a sense ofbalance in the restrictiveness of eligibility criteria around study designs and methods. A lessrestrictive approach would have compromised standards of quality and perhaps preventedmeaningful combination of data, while a more restrictive approach would have left very littlematerial to combine and analyze.

In the absence of specific biological markers, ADHD remains a descriptive, syndromic behaviouraldiagnosis, comprising behaviours which may be seen in many normal children and also in childrenwith a wide variety of other social, emotional, developmental and neuropsychological problems. Hence there is great heterogeneity among the population of children diagnosed with ADHD

Page 69: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

(over-and-above the heterogeneity associated with the specific labels of ADD vs. ADDH vs.ADHD). We attempted to reduce diagnostic heterogeneity by limiting our search to studies ofchildren who were described as having ADD or ADHD in accordance with the more stringentcriteria for diagnosing these conditions that came into effect with the publication of DSM III andsubsequent versions. Prior to DSM III, the criteria for diagnosis of Ahyperactivity@ in childrenwere more broadly defined, increasing the likelihood that early studies (prior to 1980) tended toconsist of a mixed group of children with various sorts of behavioural problems. Our stringentsearch strategy limited the number of studies (and therefore subjects) available for analysis. Notwithstanding the stringency of our eligibility criteria, the heterogeneity among subjects in theeligible studies was large, as evidenced, for example, by the variability in comorbidity acrossstudies in those that chose to report this important variable. One way of dealing with subjectheterogeneity is to analyze the data by subgroups defined by various characteristics. This strategyis now recognized as a major research need,3 but too few instances of this kind of study werefound to allow us to apply it in the present project.

Children with ADHD are heterogeneous with respect to the problems they present to clinicians(and teachers, parents and peers) as well as in their needs. Appropriate needs for one "group" ofpatients may not be appropriate for another group. This has led to the suggestion that eachADHD child requires a detailed assessment of his particular needs and an intervention programtailored accordingly.4 The research literature however has tended to assemble cohorts of ADHDcases by convenience, and provide a predetermined package of therapy or therapies withoutregard for individual needs and differences. In such situations we would expect to find thatwithin-subject research designs, which control for individual differences show larger effects, andindeed this tendency has been described.12,50 In the present study, this mechanism could explain atleast in part the strong evidence of efficacy for drug-only studies and the weak and inconsistentfindings for other kinds of interventions. The drug studies largely used within-subject designs,whereas the others all used between-subject comparisons within parallel group designs.

Besides heterogeneity in subject and study designs, other pitfalls in attempting to makecomparisons across modalities of therapy include heterogeneity in treatments and outcomemeasurements. While different dosage levels were used in studies of stimulant drug efficacy, wewere able to analyze the effects of comparable dosage levels, particularly with MPH where plentyof data were available. When we find a lack of efficacy of other therapeutic modalities however,it is important to note the variety of specific interventions that were employed across studies. Some studies evaluated the effects of individual cognitive-behavioural therapy or parent training,and others evaluated the effects of group-based interventions. A recent meta-analysis of theschool-based interventions for ADHD43 found contingency management and academicinterventions to be more effective than cognitive-behavioural procedures in terms of improvingclassroom behaviours. On the other hand, cognitive-behavioural procedures were more effectivein enhancing academic performance.43 It is noted that in our database of intervention effects, thestudies used largely cognitive-behavioural procedures, but behavioural outcomes had beendesignated as the target for assessing efficacy. A Amismatch@ of this type between specifics of theintervention and outcome would tend to conceal a potential benefit of psychological/ behaviouraltherapies in the present study.

Page 70: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Studies also varied in the Adosage level@ or intensity of such interventions. It is questionablewhether combining such data will result in valid and interpretable data. We elected to combinedata from studies that differed in their interventions in view of the broad commonalities acrossthese studies and in order to increase cumulative numbers of treated and control subjects, a primepurpose of meta-analysis. Even then, however, sample sizes remain small so that failure to findsignificant results may reflect a Type II statistical error, while discrepancies between studies mayreflect the discrepant treatments, outcome measures and control conditions they used. We believethat differences in how control groups were assembled and treated are an important source ofheterogeneity and a threat to the validity of the results.

The use of different outcome measures across studies is another such factor. Our strategy in thisstudy was to select one particular type of outcome measure that is widely-used, standardized andrelevant to the broad sweep of behaviour and learning problems that bring parents to seek help inthe first place. We reasoned that to make valid comparisons of treatment efficacy, we would haveto use a common outcome measure across treatment modalities. Furthermore, this would reduceheterogeneity between studies. The ACTRS fulfills most of these specifications, and its longerparent forms have been widely used to monitor drug effects as well as the effects of psychologicalinterventions.2 However we found that many published studies (rejected for present purposes)had not used checklist-type outcome measures at all, and among those that did, not all of themused the Conners. In this instance, we elected to extend the range of eligible outcome measuresto include behaviour rating scales, which were, in our judgment, broadly comparable with theConners scales, rather than risk an overly restricted database of intervention effects. So whilemost studies in the database used the ASQ of Conners, the inclusion of a number of differentoutcome measures raises concerns when analyzing effects combined across studies.

A further significant caveat in interpreting the results from this study is a theoretical question ofwhether it is appropriate to look to the same outcome measure to show effects of drug and non-medical interventions. Whereas parents and teachers want to see improvements in behaviouralsymptoms such as those covered in the Conners scale, it is possible that medication may be mostefficacious at reducing the primary or Acore@ symptoms of ADHD, while psychological/behavioural therapies involving parents and/or teachers may be most efficacious at reducingassociated features, such as conflicted peers relations and academic underachievement secondaryto social skill and academic skills deficits.4 The latter kinds of effects would be expected to showup less on a checklist of core symptom behaviours and more on other kinds of measures, such asdirect observations of the student, global improvement ratings by parents and teachers, peerratings and measures of individual achievement. Hence this study=s exclusive focus on behaviourrating scales may introduce a bias in favor of medication over psychological/behavioural therapies. We did not estimate efficacy in all these domains because only some studies included them, andbecause of the wide range of measures it would have necessitated combining. It has also beenquestioned whether it is justified to seek effects of home-based parent training in teacher reportsfrom the classroom.18 Unfortunately these issues remain unresolved in ADHD research. Our useof parent as well as teacher measures was an attempt to address these concerns. The finding ofinstances of differential effects on parent vs. teacher rating scales goes some way towards

Page 71: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

validating this strategy, although there is no clear explanation for the specific differences that werefound.

A criticism that could be raised about our analytic approach is that drug effects were generallyevaluated a few weeks after the onset of therapy while psychological/behavioural therapies wereevaluated over a longer time frame, and how do we know that the effects due to drugs persist.One study in our database of intervention effects (study 21) followed up children at 120 dayspost- initiation of therapy and found that improvements in teacher-rated Acore@ behaviours ofhyperactivity-inattentiveness and associated aggressive behaviours at the end of the titration phasepersisted over the 4-month follow-up. A recent paper by Gillberg et al, studying the effects ofdextroamphetamine in ADHD, similarly showed persistence of beneficial effects at 15 monthsafter initiation of therapy.51 Finally, it has been pointed out that there has been no convincingempirical demonstration of attenuation of stimulant effects over time.4,29

Our results suggest that medical therapy is efficacious in management of children with ADHD,that non-medical interventions used alone are not, and that combinations of medical and non-medical therapies may be efficacious in some situations. We have discussed above the mainreasons why these results should not be taken at face value. These include a paucity of researchto evaluate non-medical modalities of therapy with ADD/ADHD children, a lack of good qualityexperimental research and a great deal of heterogeneity between studies in choice of subjects,interventions, controls and outcome measures which made the combining of results across studiesdifficult to interpret. These and other pitfalls have led previous reviewers to conclude that Aanyattempt to identify the best treatment becomes an empty and futile exercise.@17 While this may bean overstatement, we believe these factors limit the applicability of our results towards makinghealth policy decisions, particularly as regards psychological/behavioural and combined forms oftherapy. We recommend that caution be exercised in this regard. The relative benefits ofdifferent modalities of therapy for ADHD in children may need to be revisited at such time as thedeficits identified in the published literature have been addressed. We also await with interest thefindings of a large, U.S National Institutes on Mental Health-funded multicentre experimental trialcurrently in progress. This study, known as the Collaborative Multisite Multimodal TreatmentStudy of Children with ADHD (the "MTA Study") was set up specifically to evaluate differentmodalities of therapy for ADHD.52

Page 72: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

References

1. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (4th

Ed). Washington, D.C., 1994

2. Barkley RA. Attention Deficit Hyperactivity Disorder: A Handbook for Diagnosis andTreatment. New York, Guilford Press, 1990

3. Tannock R. Attention deficit hyperactivity disorder: advances in cognitive, neurological andgenetic research. J. Child Psychol Psychiat 1998; 39:65-99

4. Dulcan M and the American Academy of Child and Adolescent Psychiatry Work Group onQuality Issues. Practice parameters for the assessment and treatment of children, adolescentsand adults with attention-deficit hyperactivity disorder. J Am Acad Child Adolesc Psychiatry1997; 36(Suppl): 85S-121S

5. Aylward GP. Practitioner=s Guide to Developmental and Psychological Testing. New York,Plenum, 1994

6. Merrell KW. Assessment of Behavioural, Social and Emotional Problems: Direct andObjective Methods for Use with Children and Adolescents. New York, Longman, 1994

7. Goyette CH, Conners CK, Ulrich RF. Normative data on Revised Conners Parent andTeachers Rating Scales. J. Abnormal Child Psychol 1978; 6:221-236

8. Conners CK. A teacher rating scale for use in drug studies with children. Am J Psychiatry1969; 126:884-888

9. Conners CK, Barkley RA. Rating scales and checklists for child psychopharmacology. Psychopharmacology Bulletin 1985; 21:809-851

10. Conners CK. Rating scales for use in drug studies with children. PsychopharmacologyBulletin 1973; Special Issue: Pharmacotherapy of Children: 24-84

11. Conners CK, Taylor E, Meo G, Kurtz MA, Fournier M. Magnesium pemoline anddextroamphetamine: a controlled study in children with minimal brain dysfunction. Psychopharmacologia 1972; 26: 321-336

12. Kavale K. The efficacy of stimulant drug treatment for hyperactivity: A meta-analysis. Journal of Learning Disabilities 1982; 15:280-289

13. Ottenbacher KJ, Cooper HM. Drug treatment of hyperactivity in children. Dev Med ChildNeurol 1983; 25:358-366

Page 73: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

14. Thurber S, Walker CE. Medication and hyperactivity: a meta-analysis. J Gen Psychol 1983;108:79-86

15. Oxman AD, Guyatt GH. Validation of an index of the quality of review articles. J ClinEpidemiol 1991; 44: 1271-1278

16. Oxman AD, Guyatt GH, Singer J, Goldsmith CH, Hutchison BG, Milner RA, Steiner DL. Agreement among reviewers of review articles. J Clin Epidemiol 1991; 44: 91-98

17. Whalen CK, Henker B. Therapies for hyperactive children: comparisons, combinations, andcompromises. J Consult Clin Psychol 1991; 59:126-137

18. Conners CK, Wells KC, Erhardt D, March JS, Shulte A et al. Multimodal therapies.Methodological issues in research and practice. Child and Adolescent Psychiatric Clinics ofNorth America 1994; 3:361-377

19. Detsky AS, Naylor CD, O=Rourke K, McGeer AJ, L=Abbe KA. Incorporating variations inthe quality of individual randomized trials into meta-analysis. J Clin Epidemiol 1992; 45:255-265

20. Chalmers TC. A method for assessing the quality of a randomized control trial. ControlledClinical Trials 1981; 2:31-49

21. Loney J, Milich R. Hyperactivity, inattention, and aggression in clinical practice. In Routh D,Wolraich M (Eds). Advances in Developmental and Behavioral Pediatrics (Vol 3, pp 113-147). Greenwich, CT, JAI Press, 1982

22. Edelbrock CS, Achenbach TA. The teacher version of the Child Behavior Profile: I. Boysaged 6-11. J Consult Clin Psychol 1984; 52: 207-217

23. Barkley RA. Attention. In Tramontana M, Hopper S (Eds). Issues in Child ClinicalNeuropsychology. New York, Plenum, 1988

24. Quay HC, Peterson DR. Interim manual for the revised Behavior Problems Checklist. Unpublished manuscript, University of Miami, 1983

25. Quay HC, Peterson DR. Appendix 1 to the interim manual for the revised Behavior ProblemsChecklist. Unpublished manuscript, University of Miami, 1983

26. Ullman RK, Sleator EK, Sprague R. A new rating scale for diagnosis and monitoring of ADDchildren. Psychopharmacology Bulletin 1984; 20: 160-164

27. Barkley RA. Defiant Children: A Clinicians= Manual for Parent Training. New York,Guilford Press, 1987

Page 74: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

28. Barkley RA. Attention-Deficit/Hyperactivity Disorder. In Mash EJ, Terdal LG (Eds). Assessment of Child and Family Disorders. 3rd ed. New York, Guilford Press, 1997, pp. 71-129

29. Greenhill LL. Attention-deficit Hyperactivity Disorder. The Stimulants. Child AdolescPsychiat Clinics of N Am 1995;4:123-168

30. Conners CK. Manual for Conners= Rating Scales. Multi-Health Systems Inc, Toronto, Ont,1989

31. Greenland S. Quantitative methods in the review of epidemiological literature. EpidemiolRev 1987; 7:177-188

32. DerSimonian R, Laird N. Meta-analysis and clinical trials. Controlled Clinical Trials 1986;7:177-188

33. Conners CK, Taylor E. pemoline, methylphenidate and placebo in children with minimal braindysfunction. Arch Gen Psychiatry 1980;37:922-932

34. Stephens R, Pelham WE, Skinner R. The state-dependent and main effects of pemoline andmethylphenidate on paired-associates learning and spelling in hyperactive children. J ConsultClin Psychol 1984; 52;104-113

35. Pelham WE, Greenslade KE, Vodde-Hamilton M, et al. Relative efficacy of long-actingstimulants on children with attention deficit-hyperactivity disorder: a comparison of standardmethylphenidate, sustained-release methylphenidate, sustained-release dextroamphetamine,and pemoline. Pediatrics 1990;86:226-37

36. Elia J, Borcherding BG, Rapopport JL, Keysor CS. Methylphenidate and dextroamphetaminetreatments of hyperactivity: are there true nonresponders? Psychiatry Research 1991;36(2):141-155

37. Shevell M, Schreiber R. pemoline-associated hepatic failure: a critical analysis of theliterature. Pediatr Neurol 1997; 16:14-16

38. Abikoff H, Gittelman R. Does behaviour therapy normalize the classroom behaviour ofhyperactive children? Arch Gen Psychiatry 1984; 41:449-454

39. Abikoff H, Gittelman R. Hyperactive children treated with stimulants: is cognitive training auseful adjunct? Arch Gen Psychiatry 1985; 42:953-961

40. Abikoff H. An evaluation of cognitive behaviour therapy for hyperactive children. In LaheyBB, Kazdin AE (Eds). Advances in Clinical Child Psychology 1987; 10:171-216

Page 75: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

41. Dubey DR, O=Leary SG, Kaufman KF. Training parents of hyperactive children in childmanagement: a comparative outcome study. J Abn Child Psychol 1983; 11:229-246

42. Carlson CL, Pelham WE, Milich R, Dixon J. Single and combined effects of methylphenidateand behaviour therapy on the classroom performance of children with attention deficithyperactivity disorder. J Abn Child Psychol 1992; 20:213-232

43. DuPaul GJ, Eckert TL. The effects of school-based intervention for attention deficithyperactivity disorder: a meta-analysis. School Psychology Review 1997; 26:5-27

44. Horn WF, Chatoor I, Conners CK. Additive effects of Dexedrine and self-control training: amultiple assessment. Behav Modif 1983; 383:402

45. Pelham WE, Murphy HA. Behavioural and pharmacological treatment of hyperactivity andattention-deficit disorders. In Herson M, Breuning SE (Eds). Pharmacological andBehavioural Treatment: An Integrative Approach. New York, Wiley 1996

46. Gittelman R, Abikoff H, Poslack E, Klein DF, Katz S et al. A controlled trial of behaviourmodifications and methylphenidate in hyperactive children. In Whalen C, Henker B (Eds). Hyperactive Children: The Social Ecology of Identification and Treatment. New York,Academic Press 1980

47. Hinshaw SP, Erhardt D. Attention deficit hyperactivity disorder. In Kendall PC (Ed). Childand Adolescent Therapy: Cognitive-behavioural procedures. New York, Guilford Press 1991

48. Hinshaw SP, Henker B, Whalen CK. Cognitive-behavioural and pharmacological interventionfor hyperactive boys: comparative and combined effects. J Consult Clin Psychol 1984;52:739-749

49. Pelham WE, Carlson C, Sams S, Vallano G, Dixon MJ et al. Separate and combined effectsof methylphenidate and behaviour modifications on boys with attention deficit-hyperactivitydisorder in the classroom. J Consult Clin Psychol 1993; 61:506-515

50. Lipsey MW, Wilson DB. The efficacy of psychological, educational and behaviouraltreatment. American Psychologist 1993; 48:1181-1209

51. Gillberg C, Melander H, von Knorring A-L, Janols L-O, Thernlund G, Hagglof B, Eidevall-Wallin L, Gustafsson P, Kopp S. Long-term stimulant treatment of children with Attention-Deficit Hyperactivity disorder symptoms. Arch Gen Psychiatry 1997; 54: 857-864

52. Arnold LE, Abikoff HB, Cantwell DP, Conners CK, Elliot G, Greenhill LL et al. NationalInstitution of Mental Health Collaborative Multimodal Treatment Study of Children withADHD (the MTA). Design Challenges and Choices. Arch Gen Psychiatry 1997; 54:865-870

Page 76: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Table 1. Study Eligibility Criteria

AREA CRITERIA

1. Date of Publication 1981 or later

2. Study design Prospective studies of an intervention or interventions which had to be either parallel-group designs with random assignment of subjects to treatment conditions or within-subject crossover designs with random assignment of subjects to treatment order. Observational (cohort) and single subject studies were ineligible.

3. Target population Children 0-18 years with a diagnosis of ADD, ADDH or ADHD made in an explicit andreproducible way.

4. Co-morbidity Studies involved subjects unselected as to the presence of specific associated or co-existing diagnoses such as Tourette or other tic disorder, mental retardation, autism,learning disability or conduct disorder. However the presence of these and othercomorbidities such as anxiety, depression and aggression was acceptable provided thatthe focus of the study was not the effect of an intervention on a specific ADHD sub-population as defined by the presence of such comorbid diagnoses.

5. Intervention Effects of at least 1 week of stimulant medication (MPH, DAS, pemoline) administeredon consecutive days.

Effects of a course of psychosocial intervention which may include:-contingency management methods (behaviour modification, parent-or teacher -mediated)-cognitive-behavioural therapy-individual psychotherapy-parent training and education-teacher training and education-parent or family counseling/therapy-social skills training-EEG biofeedback or relaxation therapy

6. Outcome measures The focus was on effects of intervention on aspects of behaviour that are discernible toteachers, and/or parent, and/or clinicians in everyday life.Outcomes were measured with standardized behaviour rating scale-type of instrumentswhich measure in a broad-based way core ADHD behaviours (inattention, distractibility,impulsiveness and hyperactivity) as well as the disruptive behaviours that are the mostsalient associated feature of ADHD. Excluded were outcome measures specific toacademic performance, cognitive function, neurological/physiological measures andother laboratory-based measures.

7. Data presentation Outcome data to be presented in a form that is complete and suitable to be extractedfor meta-analysis.

Page 77: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Table 2. Total Number of Citations Identified Through Electronic Database Searches

OVID PLATFORM(Medline, Current Contents,Health Star) 705

PyscInfo (1980 - present) 496

CIJE 70

First Search 137

Embase 167

Page 78: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Table 3. Details of Ineligible Studies

CATEGORY/SUBCATEGORY/DESCRIPTION Number(%)

Total ineligible treatment studies

Ineligible by Design criterion (no further evaluation of eligibility status)Not a randomized clinical trial (e.g. observational study, single subject experiment).Randomization procedure found to be faulty by investigators

16946

(27%)

Treatment studies remaining for further evaluation of eligibility

Ineligible by Subject criterionSubjects older than 18 yearsNot clear if subjects had diagnosis of ADD/ADHD and/or how diagnosis ascertainedSubjects all carried a particular comorbid diagnosisOther (e.g. some subjects had ADD/ADHD, others had different behavioural disorders)Ineligible by Intervention criterionDrug therapy lasted less than 7 daysDrug used but data not reportedType of intervention was not on eligible list (e.g. dietary)Other (e.g. comparison of two types of psychological/behavioural therapies)Ineligible by Outcomes criterionBehaviour rating scale was not usedBehaviour rating scale used but was not a predetermined >eligible= measure (see Appendix 2)Ineligible by Data criterion

Data not presented in a form usable for meta-analysis (e.g. means and s.d.=s notreported)Ineligible by Other criteriaData already reported in another publicationEligible behaviour rating scale used but data not reported (not a focus of study)

123

33(27%)

38(31%)

71(58%)

27(22%)

4(3%)

Note: of 123 studies not eliminated by Design criterion:76 (62%) were ineligible by a further single criterion44 (36%) were ineligible by two further criteria3 (2%) were ineligible by three or more criteria

Page 79: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Table 4. Characteristics of Studies in Database of Intervention Effects

Studyidentifier

Author and year ofpublication

Studydesign

Intervention Samplesize

Agerange(yr)

% male Qualityscore(%)

Descriptionofcomorbidityprovided

Teacherscale

Parentscale

1 Arnold et al. 1989 within DAS 18 6-12 100 38 No ACTRS

2 Barkley et al. 1985 within MPH 60 5-9 100 59 No HSQ

3 Bloomquist et al. 1991 between psych/behav 36 6-11 69 65 Yes ACTRS

4 Brown and Sexson 1988 within MPH 11 12-14 100 76 Yes ACTRS ACPRS

5 Brown et al. 1986 between combination 33 5-13 85 81 Yes ACTRS ACPRS

6 Brown et al. 1985 between combination 40 6-12 100 50 No ACTRS ACPRS

7 Donnelly et al. 1989 within DAS 19 6-12 100 62 No ACTRS

8 DuPaul et al. 1994 within MPH 40 6-12 notstated

69 No CAP HSQ

9 DuPaul and Rapport 1993 within MPH 31 6-11 82 85 No ACTRS

10 Evans and Pelham 1991 within MPH 9 11-15 100 79 Yes IowaConners

11 Fehlings et al. 1991 between psych/behav 26 7-13 100 67 No RBPC RBPC

12 Firestone et al. 1986 between combination 51 5-9 notstated

64 No ACTRS

For abbreviations: see text or Glossary of Abbreviations

Page 80: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Table 4 continued

Studyidentifier

Author and year ofpublication

Studydesign

Intervention Samplesize

Agerange(yr)

%male

Qualityscore(%)

Descriptionofcomorbidityprovided

Teacherscale

Parentscale

13 Fischer and Newby 1991 within MPH 161 2-17 88 94 No ACTRS ACPRS

14 Fitzpatrick et al. 1992 within MPH 19 6-12 89 79 Yes ACTRS ACPRS

15 Klorman et al. 1994 within MPH 78 5-12 85 91 Yes ACTRS ACPRS

16 McBride 1988 within MPH 66 6-17 79 71 No ACTRS ACPRS

17 Musten et al. 1997 within MPH 31 4-6 84 92 Yes ACPRS

18 Pelham et al. 1995 within pemoline 28 5-12 79 79 No ACTRS

19 Rapport et al. 1989 within MPH 45 5-12 100 85 No ACTRS

20 Rapport et al. 1987 within MPH 42 6-11 88 82 No ACTeRS

21 Schachar et al. 1997 between MPH 66 6-12 76 88 Yes IowaConners

IowaConners

22 Stein et al. 1996 within MPH 24 6-12 100 88 Yes ACTeRS ACPRS

23 Tirosh et al. 1993 within MPH 20 7-12 80 71 No ACPRS

24 Zametkin et al. 1985 within DAS 14 8-12 100 76 Yes ACTRS ACPRS

25 Amery et al. 1984 Within DAS 10 8-11 100 74 No ACTRS

26 Buitelaar et al. 1996 between MPH 21 6-13 94 91 Yes ACTRS ACPRS

For abbreviations: see text or Glossary of Abbreviations

Page 81: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Table 5. Studies of Drug TreatmentsStudy

identifierAuthor and year ofpublication

Drug type No. dosagelevels given

in study

Dose level(mg/kg/day)

used in meta-analysis

Period forfollow-up

(days)

1 Arnold et al. 1989 DAS 1 .53 14

2 Barkley et al. 1985 MPH 2 .60 9

4 Brown and Sexson 1988 MPH 3 .60 14

7 Donnelly et al. 1989 DAS 1 .50 21

8 DuPaul et al. 1994 MPH 3 .49 7

9 DuPaul and Rapport 1993 MPH 4 .70 7

10 Evans and Pelham 1991 MPH 2 .45 14

13 Fischer and Newby 1991 MPH 2 .80 7

14 Fitzpatrick et al. 1992 MPH 1 .56 14

15 Klorman et al. 1994 MPH 1 .76 21

16 McBride 1988 MPH 1 .60 14

17 Musten et al. 1997 MPH 2 .60 9

18 *Pelham et al. 1995 Pem 4 (a)2.53(b)1.27

7

19 Rapport et al. 1989 MPH 4 .72 7

20 Rapport et al. 1987 MPH 4 .66 7

21 Schachar et al. 1997 MPH 1 1.2 25 and 120

22 Stein et al. 1996 MPH 2 .60 7

23 Tirosh et al. 1993 MPH 1 .80 8

24 Zametkin et al. 1985 DAS 1 .46 7

25 Amery et al. 1984 DAS 1 .75 14

26 Buitelaar et al. 1996 MPH 1 .60 28

* Analyses were performed using two dose levels for pemoline (see text).

Page 82: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Table 6. Studies of Psychological/Behavioural Treatments

Studyidentifier

Author and yearof publication

Interventions andnumber of subjects ineach group

Sample and methods Duration of intervention Trainers Follow-up (frombaseline)

3 Bloomquist et al.1991

i. multicomponent CBT -child, parent and teacher (n=11)

ii. teacher component(n=12)

iii. no treatment controlgroup (assignment random) (n=13)

Children with ADHD wereidentified at 3 schools. Twoschools were selected atrandom to be the sites forthe treatment arms. Subjects in these schoolswere randomly assigned toeither multicomponent orteacher only intervention. The third school providedcontrol subjects.

child component - 20x1-hrgroup (6-8 children)sessions over 10 weeks

teacher component - 1x120min inservice and 6x45-60min group sessions over 10weeks

parent component - 7x90min group sessionseducating on ADHD

school psychologistsat the two schoolswere trained tofunction as primarytherapists; undergradpsychology studentswere cotherapists

Pre-test10 week post-test16 week follow-up

11 Fehlings et al.1991

I. CBT (n=13)

ii. control group(assignment random)(n=13)

Children were referred toChild Development Clinic atone hospital. Subjectswere randomized to thetreatment or control group.

child component -12x60minindividual sessions, mettwice weekly

parent component -sessions 8x120minsessions in parents home,met once every two weeks

control - (child) sameexposure to therapists,tasks and rewards but noinstruction in CBTstrategies; (parent) sameeducation about ADHD,time and exposure totherapists but CBTreplaced with supportivelistening

behavioural therapist pre-test4 month post-test5 month follow-up

Page 83: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Table 7. Studies of Combination TreatmentsStudyidentifier

Author andyear ofpublication

Interventions andnumber of subjects ineach group

Sample and methods Duration Trainers Follow-up(frombaseline)

5 Brown et al.1986

i. medication (0.6 mg/kgMPH) and attention control(n=7)

ii. cognitive therapy andplacebo drug (n=10)

iii. medication (0.6 mg/kgMPH) and cognitivetherapy(n=9)

iv. attention control andplacebo drug (n=7)

Children were referredto the project and wereassigned randomly toone of four treatmentgroups.

treatment - 22x1hrindividual CBT sessionsover 3 months

control - equivalentexposure to trainingmaterials and therapistbut no instructions inproblem-solvingstrategies

had master=s degreesin psychology orspecial education

Pre-test3 monthpost-test6 monthfollow-up

6 Brown et al.1985

i. medication (0.6 mg/kgMPH) (n=10)

ii. cognitive training (n=10)

iii. medication (0.6 mg/kgMPH) and cognitive training(n=10)

iv no treatment comparisongroup (n=10)

Children were referredto the project and wererandomly assigned toone of three treatmentgroups. Assignment tocomparison group notrandom as subjectsrecruited from pastwaiting list at authors=clinic.

children - 24x60 minindividual sessions over 3months

parent and teacher givenconsultation sessions onapplying trainingstrategies (amount notdescribed); mothersobserved several trainingsessions of their childrenfrom behind one-waymirror and instructed onhow training procedurescould be applied at home

not described pre-test3 monthpost-test6 monthfollow-up

Page 84: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

12 Firestone etal. 1986

i. parent training andmedication (0.93 mg/kgMPH) (n=16)

ii. parent training andplacebo drug (n=13)

iii. medication (0.93 mg/kgMPH) (n=22)

Children were recruitedfrom referrals tolearning, psychiatry orpsychology outpatientservices at one hospital. Subjects wererandomly assigned toone of three groups.

parent - in 3 initialconsultation sessions,asked to read a book andunderstand thebehavioural principles;asked to join a parentgroup and attend 6sessions to learn childbehaviour managementprograms and how todeal with schoolpersonnel.teacher - 2 consultationswere provided toteachers involved in study

senior doctoral-levelinterns in clinicalpsychology supervisedby registeredpsychologists

pre-test3 monthpost-test10-12 monthfollow-up22-24 monthfollow-up

Page 85: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Table 8. Outcome Measures Completed by Teachers

Type of intervention

Instrument Drug Psych/behavioural

Combination Total

Abbreviated Conners TeacherRating Scale (ACTRS)

13 1 2 17

IOWA Conners Teacher RatingScale(IOWA CTRS)

2 0 0 2

ADD-H Comprehensive TeacherRating Scale (ACTeRS)

2 0 0 2

Child Attention Profile(CAP)

1 0 0 1

Revised Behaviour ProblemChecklist(RBPC)

0 1 0 1

Total 18 2 3 23

Table 9. Outcome Measures Completed by Parents

Type of intervention

Instrument Drug Psych/behavioural

Combination Total

Abbreviated Conners Parent RatingScale (ACTRS)

10 0 2 12

Home Situations Questionnaire(HSQ)

2 0 0 2

IOWA Conners Parent Rating Scale(IOWA CPRS)

1 0 0 1

Revised Behaviour ProblemChecklist(RBPC)

0 1 0 1

Total 13 1 2 16

Page 86: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Table 10. Differences in Effect Size: Drug StudiesConner Teacher Rating Scale No. of

studiesNo.

subjectstreated

No.subjectscontrol

WMD 95% CI

MPH vs. placebo 8 421 422 -6.732 -7.567 -5.887

DAS vs. placebo 4 61 61 -4.711 -6.431 -2.992

pemoline vs. placebo high doselow dose

1 28 28 -7.800-4.00

-11.239-7.80

-4.361-0.20

Table 11. Differences in Effect Size: Teacher Rating Scales

Teacher rating scales No. ofstudies

No.subjectstreated

No.subjectscontrol

SMD 95% CI

Drug vs. placebopemoline high dosepemoline low dose

1818

662662

655655

-1.065-1.028

-1.243-1.212

-0.886-0.843

Psychological/behavioural vs. control 2 24 26 -0.398 -1.276 0.480

Combination vs. placebo/comparison 2 19 17 -0.794 -1.996 0.408

Combination vs. drug 3 35 41 0.251 -0.206 0.708

Combination vs. psychological/behavioural 3 35 33 -0.437 -0.922 0.049

Table 12. Differences in Effect Size: Parent Rating Scales

Parent rating scales No. ofstudies

No.subjectstreated

No.subjectscontrol

SMD 95% CI

Drug therapy vs. placebo 13 571 564 -0.859 -1.140 -0.578

Psychological/behavioural vs. control 1 13 13 -0.488 -1.270 0.294

Combination vs. placebo/comparison 2 19 17 -1.252 -2.925 0.421

Combination vs. drug 2 19 19 -0.118 -0.755 0.520

Combination vs. psychological/behavioural 2 19 20 -1.267 -1.973 -0.561

Page 87: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Table 13. Differences in Effect Size: Conner Teacher Rating Scale

Teacher rating scales No.ofstudies

No.subjectstreated

No.subjectscontrol

WMD 95% CI

Drug vs. placebopemoline high dosepemoline low dose

1313

510510

511511

-6.447-6.265

-7.290-7.140

-5.604-5.390

Psychological/behavioural vs. control 1 11 13 0.300 -4.469 5.069

Combination vs. placebo/comparison 2 19 17 -3.777 -8.064 0.510

Combination vs. drug 3 35 41 1.285 -0.717 3.286

Combination vs. psychological/behavioural 3 35 33 -2.006 -4.174 0.163

Table 14. Differences in Effect Size: Conner Parent Rating Scale

Parent rating scales No. ofstudies

No.subjectstreated

No.subjectscontrol

WMD 95% CI

Drug therapy vs. placebo 9 403 404 -4.515 -5.790 -3.241

Psychological/behavioural vs. control 0

Combination vs. placebo/comparison 2 19 17 -7.345 -

12.289

-2.401

Combination vs. drug 2 19 19 -0.460 -3.861 2.942

Combination vs. psychological/behavioural 2 19 20 -5.911 -8.631 -3.190

Page 88: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

LIST OF FIGURES B PART 2

Figure 1 Meta-analysis of Drug Therapy Effects vs Placebo. Teacher Rating Scales (Pemoline low dose condition)

Figure 2 Meta-analysis of Drug Therapy Effects vs Placebo. Teacher Rating Scales (Pemoline high dose condition)

Figure 3 Meta-analysis of Drug Therapy Effects vs Placebo. Abbreviated Conners Teacher Rating Scale (ACTRS) (Pemoline low dose condition)

Figure 4 Meta-analysis of Drug Therapy Effects vs Placebo. Abbreviated Conners Teacher Rating Scale (ACTRS) (Pemoline high dose condition)

Figure 5 Meta-analysis of Drug Therapy Effects vs Placebo. Parent Rating ScalesFigure 6 Meta-analysis of Drug Therapy Effects vs Placebo. Conners Parent Rating Scales

(ACPRS)Figure 7 Meta-analysis of MPH Effects vs Placebo. ACTRS.Figure 8 Meta-analysis of DAS Effects vs Placebo. ACTRS.Figure 9 Meta-analysis of Pemoline Effects vs Placebo. ACTRS. (Pemoline low dose)Figure 10 Meta-analysis of Pemoline Effects vs Placebo. ACTRS. (Pemoline high dose)Figure 11 Meta-analysis of Psychological/Behavioural Therapy Effects vs Control Group.

Teacher Rating ScalesFigure 12 Meta-analysis of Psychological/Behavioural Therapy Effects vs Control Group.

ACTRSFigure 13 Meta-analysis of Psychological/Behavioural Therapy Effects vs Control Group.

Parent Rating ScalesFigure 14 Meta-analysis of Combination Therapy Effects vs Control/Companion Group.

ACTRSFigure 15 Meta-analysis of Combination Therapy Effects vs Control/Companion Group.

ACPRSFigure 16 Meta-analysis of Combination Therapy Effects vs Drug Therapy. ACTRSFigure 17 Meta-analysis of Combination Therapy Effects vs Drug Therapy. ACPRSFigure 18 Meta-analysis of Combination Therapy Effects vs Psychological/Behavioural

Therapy. ACTRSFigure 19 Meta-analysis of Combination Therapy Effects vs Psychological/Behavioural

Therapy. ACPRS

Page 89: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies
Page 90: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies
Page 91: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies
Page 92: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies
Page 93: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies
Page 94: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies
Page 95: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies
Page 96: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies
Page 97: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies
Page 98: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies
Page 99: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies
Page 100: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies
Page 101: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies
Page 102: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies
Page 103: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies
Page 104: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies
Page 105: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies
Page 106: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies
Page 107: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies
Page 108: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Appendix 1: Key Sources for Handsearching

Abikoff HB, Hechtman L. Multimodal therapy and stimulants in thetreatment of children with attention deficit hyperactivity disorder. In: HibbsED, Jensen PS (Eds). Psychosocial treatments for child and adolescentdisorders: Empirically Based Strategies for Clinical Practice. Washington,D.C., American Psychological Association, 1996

Cantwell DP. Attention deficit disorder: a review of the past 10 years. J AmAcad Child Adolesc Psychiatry 1996; 35: 978-987

Dulcan M and the American Academy of Child and Adolescent PsychiatryWork Group on Quality Issues. Practice parameters for the assessment andtreatment of children, adolescents and adults with attention-deficithyperactivity disorder. J Am Acad Child Adolesc Psychiatry 1997;36(Suppl): 85S-121S

Rapopport JL, Castellanos FX. Attention-deficit/hyperactivity disorder. InWeiner HM (Ed). Diagnosis and Psychopharmacology of Childhood andAdolescent Disorders, (2nd Ed). New York, Wiley 1996

Richters JE, Arnold LE, Jensen PS, Abikoff H, Conners CK et al. NIMHCollaborative Multisite Multimodal Treatment Study of Children withADHD: I. Background & rationale. J Am Acad Child Adolesc Psychiatry1995, 34:987-100

Schachar R, Tannock R, Cunningham C. Treatment. In Sandberg S (Ed). Hyperactivity Disorders of Childhood. Cambridge, Cambridge UniversityPress, 1996

Shaywitz BA, Fletcher JM, Shaywitz SE. Attention-deficit hyperactivitydisorder. Advances in Pediatrics 1997; 44:331-367

Spencer T, Biederman J, Wilens T, Harding M, O=Donnell D, et al. Pharmacotherapy of attention deficit hyperactivity disorder across the lifecycle. J Am Acad Child Adolesc Psychiatry 1996; 35:409-432

Waslick B, Greenhill L. Attention-deficit hyperactivity disorder. In WienerJ (Ed). Textbook of Child and Adolescent Psychiatry (2nd ed). WashingtonDC, American Psychiatric Press, 1997

Weiss G. Attention deficit hyperactivity disorder. In Lewis M (Ed). Childand Adolescent Psychiatry: a Comprehensive Textbook (2nd ed). Baltimore,Williams & Wilkins, 1996

Page 109: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Appendix 2: Algorithmic Chart for Selection of Behaviour Rating Scales

Method:1. From each paper, extract data from the first measure on the list and specify measure used.2. If Teacher & Parent Measures were used: record data from first measure on each list.

Otherwise, just record Teacher or Parent measure.A. TEACHER MEASURES

1. Conners Teacher Rating Scale-Abbreviated Symptom Questionnaire (CASQ/Hyperactivity Index/@Index@)

2. IOWA Conners Teacher Rating Scale-Total ADHD behaviours score-If not given, use: Inattention/overactivity score and Oppositional/defiant scores

3. Achenbach Child Behaviour Checklist - Teacher Report Form (TRF)-Attentional Problems score-If not given, use: Externalizing behaviours score(if neither of above reported, set aside for Anton to check)

4. Child Attention Profile (CAP) (Barkley, 1988)-use Total Score-If not given, use: subscale scores

5. School Situations Questionnaire - Original or Revised Version (SSQ or SSQ-R)-use Total Severity score

6. Revised Behaviour Problem Checklist (RBPC) (Quay, 1983/4)-use Attention problems - Immaturity score

7. ADD-H Comprehensive Teacher Rating Scale (ACTeRS)-use Attention and Hyperactivity scores

8. Attention-Deficit Disorder Evaluation Scale (ADDES)-use Total score-If not given, use: Inattentive, Impulsive and Hyperactive scores

9. Children=s Attention & Adjustment Survey (CAAS) (Lambert, 1990)

10. ADHD Rating Scale (DuPaul, 1990)-use Total score-If not given, use: subscale scores

Page 110: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

11. Swanson, Nolan & Pelman (SNAP)

Page 111: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

B. PARENT MEASURES

1. Conners Parent Rating Scale-Abbreviated Symptom Questionnaire (CASQ/Hyperactivity Index/@Index@)

2. Conners, Loney & Milich Questionnaire (CLAM) (Swanson, 1989)-use Conners Hyperactivity Index Score-If not given, use: IOWA Conners mixed Inattention/overactivity score and Oppositional/defiant factor scores

3. Achenbach Child Behaviour Checklist-Attentional Problems score-If not given, use: Externalizing Behaviours score(if neither of above reported, set aside for Anton to check)

4. Home Situations Questionnaire - Original or Revised version (HSQ or HSQ-R)-use Total Severity score

5. Revised Behaviour Problem Checklist (RBPC) (Quay, 1983/4)-use Attention problems - Immaturity score

6. Attention-Deficit Disorder Evaluation Scale (ADDES)-use Total score-If not given, use: Inattentive, Impulsive and Hyperactive scores

7. Children=s Attention & Adjustment Survey (CAAS) (Lambert, 1990)

8. ADHD Rating Scale (DuPaul, 1990)-use Total score-If not given, use: subscale scores

9. Swanson, Nolan & Pelham (SNAP)

Page 112: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Appendix 3: Reviewed Treatment Studies

Abikoff H, Ganeles D, Reiter G, Blum C, Foley C, Klein RG. Cognitive training in academicallydeficient attention-deficit hyperactivity disorder boys receiving stimulant medication. J AbnormChild Psychol 1988;16(4):411-432.

Abikoff H, Gittelman R. Does behavior therapy normalize the classroom behavior of hyperactivechildren? Arch Gen Psychiatry 1984;41(5):449-54.

Abikoff H, Gittelman R. Hyperactive children treated with stimulants: is cognitive training auseful adjunct. Arch Gen Psychiatry 1985;42(10):953-61.

Abramowitz AJ, Eckstrand D., O'Leary SG, Dulcan MK. Attention-deficit hyperactivity disorderchildren's responses to stimulant medication and two intensities of a behavioral intervention.Behav Modif 1992;16(2):193-203.

Ajibola O, Clement PW. Differential effects of methylphenidate and self-reinforcement onattention-deficit hyperactivity disorder. Behav Modif 1995;19(2):211-33.

Alessandri SM, Schramm K. Effects of dextroamphetamine on the cognitive and social play of apreschooler with attention-deficit hyperactivity disorder. J Am Acad Child Adolesc Psychiatry1991;30(5):768-72.

Alston CY, Romney DM. A comparison of medicated and nonmedicated attention-deficitdisordered hyperactive boys. Acta Paedopsychiatr 1992;55(2):65-70.

Aman MG, Turbott SH. Prediction of clinical response in children taking methylphenidate. JAutism Dev Disord 1991;21(2):211-28.

Anastopoulos AD, Shelton TL, DuPaul GJ, Guevremont DC. Parent training for attention-deficithyperactivity disorder: its impact on parent functioning. J Abnorm Child Psychol 1993;21(5):581-596.

Anderson EE, Clement PW, Oettinger L. Methylphenidate compared with behavioral self-controlin attention deficit disorder: preliminary report. Dev Behav Pediatr 1981; 2(4):137-41.

Arnett PA, Fischer M, Newby RF. The effects of ritalin on response to reward and punishment inchildren with attention-deficit hyperactivity disorder. Child Study J 1996;26(1):51-70.

Arnold LE, Kleykamp D, Votolato NA, Taylor WA, Kontras SB, Tobin K. Gamma-linolenic acidfor attention-deficit hyperactivity disorder: placebo-controlled comparison to D-amphetamine.Biol Psychiatry 1989;25(2):222-8.

Arnold LE, Sheridan K, Estreicher D. Multifamily parent-child group therapy for behavior and

Page 113: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

learning disorders. J Child Adolesc Psychotherapy 1986;3(4):279-84.Ballinger CT, Varley CK, Nolen PA. Effects of methylphenidate on reading in children withattention deficit disorder. Am J Psychiatry 1984;141(12):1590-3.

Barkley RA, DuPaul GJ, McMurray MB. Attention deficit disorder with and withouthyperactivity: clinical response to three dose levels of methylphenidate. Pediatrics1991;87(4):519-31.

Barkley RA, Guevremont DC, Anastopoulos AD, Fletcher KE. A comparison of three familytherapy programs for treating family conflicts in adolescents with attention-deficit hyperactivitydisorder. J Consult Clin Psychol 1992;60(3):450-62.

Barkley RA, Karlsson J, Pollard S, Murphy JV. Developmental changes in the mother-childinteractions of hyperactive boys: effects of two dose levels of ritalin. J Child Psychol Psychiatry1985;26(5):705-15.

Barkley RA, McMurray MB, Edelbrock CS, Robbins K. The response of aggressive andnonaggressive attention-deficit hyperactivity disorder children to two doses of methylphenidate. JAm Acad Child Adolesc Psychiatry 1989;28(6):873-81.

Barkley RA, Strzelecki E, Karlsson J, Murphy JV. Effects of age and ritalin dosage on themother-child interactions of hyperactive children. J Consulting and Clinical Psychology1984;52(5):750-758.

Barkley RA. The effects of methylphenidate on the interactions of preschool attention-deficithyperactivity disorder children with their mothers. J Am Acad of Child Adolesc Psychiatry1988;27(3):336-341.

Barkley RA. Hyperactive girls and boys: stimulant drug effects on mother-child interactions. JChild Psychol Psychiatry 1989;30(3):379-390.

Barkley RA, McMurray MB, Edelbrock CS, and Robbins K. Side effects of methylphenidate inchildren with attention deficit hyperactivity disorder: A systematic, placebo-controlled evaluation.Pediatrics 1990;86(2):184-192.

Barrickman LL, Perry PJ, Kuperman S, Arndt SV, Herrmann KJ, Schumacher E. Bupropionversus methylphenidate in the treatment of attention-deficit hyperactivity disorder. J Am AcadChild Adolesc Psychiatry 1995;34(5):649-57.

Bloomquist ML, August GJ, Ostrander R. Effects of a school-based cognitive-behavioralintervention for attention-deficit hyperactivity disorder children. J Abnorm Child Psychol 1991;19(5):591-605.

Borcherding BG, Keysor CS, Cooper TB, Rapoport JL. Differential effects of methylphenidate

Page 114: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

and dextroamphetamine on the motor activity level of hyperactive children.Neuropsychopharmacology 1989;2(4):255-63.

Brown RT, Wynne ME, Medenis. Methylphenidate and cognitive therapy: a comparison oftreatment approaches with hyperactive boys. J Abnorm Child Psychol 1985;13:69-87.

Brown RT, Borden KA, Wynne MA, Spunt AL, Clingerman SR. Compliance withpharmacological and cognitive treatments for attention deficit disorder. J Am Acad Child AdolescPsychiatry 1987;26(4):521-6.

Brown RT, Sexson SB. A controlled trial of methylphenidate in black adolescents. Attentional,behavioral, and physiological effects. Clin Pediatr 1988;27(2):74-81.

Brown RT, Wynne ME, Borden KA, Clingerman SR, Geniesse R, Spunt AL. Methylphenidateand cognitive therapy in children with attention deficit disorder: a double-blind trial. J Dev BehavPediatr 1986;7(3):163-74.

Brown RT, Borden KA, Wynne ME, Schleser R, Clingerman SR. Methylphenidate and cognitivetherapy with attention deficit disorder children: a methodological reconsideration. J Abnorm ChildPsychol 1986;14(4):481-97.

Brown RT, Borden KA, Wynne ME, Spunt AL, Clingerman SR. Patterns of compliance in atreatment program for children with attention deficit disorder. J Compliance Health Care1988;3(1):23-39.

Buhrmester D, Whalen CK, Henker B, MacDonald V, Hinshaw SP. Prosocial behavior inhyperactive boys: effects of stimulant medication and comparison with normal boys. J AbnormChild Psychol 1992;20(1):103-21.

Buitelaar JK, Van der Gaag RJ, et al. Prediction of clinical response to methylphenidate inchildren with attention deficit hyperactivity disorder. J Am Acad Child Adolesc Psychiatry1995;8:1025-1032.

Butter HJ, Lapierre Y, Firestone P, Blank A. Efficacy of ACTH 4-9 analog, methylphenidate, andplacebo on attention deficit disorder with hyperkinesis. Prog Neuropsychopharmocol BiolPsychiatry 1984;8:661-4.

Caresia L, Pugnetti L, Besana R, Barteselli F, Guareschi Cazzullo A, Musetti L,Scarone S. EEG and clinical findings during pemoline treatment in children and adults withattention deficit disorder. Neuropsychology 1984;11(3):158-67.

Carlson CL, Pelham WE Jr, Swanson JM, Wagner JL. A divided attention analysis of the effectsof methylphenidate on the arithmetic performance of children with attention-deficit hyperactivitydisorder. J Child Psychol Psychiatry 1991;32(3):463-71.

Page 115: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Carlson CL, Pelham WE, Milich R, Dixon J. Single and combined effects of methylphenidate andbehavior therapy on the classroom performance of children with attention-deficit hyperactivitydisorder. J Abnorm Child Psychol 1992;20(2):213-32.

Castellanos FX, Giedd JN, Elia J, Marsh WL, Ritchie GF, Hamburger SD, Rapoport JL.Controlled stimulant treatment of attention-deficit hyperactivity disorder and comorbid Tourette'ssyndrome: effects of stimulant and dose. J Am Acad Child Adolesc Psychiatry 1997;36(5):589-96.

Charles L, Schain R. A four-year follow-up study of the effects of methylphenidate on thebehavior and academic achievement of hyperactive children. J Abnorm Child Psychol1981;9(4):495-505.

Charles L, Schain R, Zelinker. Optimal dosages of methylphenidate for improving the learningand behavior of hyperactive children. J Dev Behav Pediatrics 1981;2:78-81.

Cohen NJ, Sullivan J, Minde K, Novak C, Helwig C. Evaluation of the relative effectiveness ofmethylphenidate and cognitive behavior modification in the treatment of kindergarten-agedhyperactive children. J Abnorm Child Psychol 1981;9(1):43-54.

Coons HW, Borgstedt AD, Klorman R. Effects of methylphenidate on adolescents with achildhood history of attention deficit disorder: II. Information processing. J Am Acad ChildAdolesc Psychiatry 1987;26(3):368-74.

Cotton, MF, Rothberg, AD. Methylphenidate v. placebo: a randomized double-blind crossoverstudy in children with the attention deficit disorder. S Afr Med J 1988;74:268-271.

Cunningham CE, Siegel LS, Offord DR. A developmental dose-response analysis of the effects ofmethylphenidate on the peer interactions of attention-deficit disordered boys. J Child PsycholPsychiatry 1985;26(6):955-71.

Cunningham CE, Siegel LS, Offord DR. A dose-response analysis of the effects ofmethylphenidate on the peer interactions and simulated classroom performance of attention-deficitdisorder children with and without conduct problems. J Child Psychol Psychiatry 1991;32(3):439-52.

Dalby JT, Kinsbourne M, Swanson JM. Self-paced learning in children with attention-deficitdisorder with hyperactivity. J Abnorm Child Psychol 1989;17(3):269-75.

de Sonneville LMJ, Nijiokiktjien C, Bos H. Methylphenidate and information processing: Part 1.Differentiation between responders and nonresponders; Part 2. Efficacy in responders. J Clin ExpNeuropsychol 1994;16(6):877-97.

Page 116: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Denkowski KM, Denkowski GC. Is group progressive relaxation training as effective as effectivewith hyperactive children as individual EMG biofeedback treatment?. Biofeedback Self Regul1984;9(3):353-64.

Donnelly M, Rapoport JL, Potter WZ, Oliver J, Keysor CS, Murphy DL. Fenfluramine anddextroamphetamine treatment of childhood hyperactivity: clinical and biochemical findings. ArchGen Psychiatry 1989;46(3):205-12.

Douglas VI, Barr RG, O'Neill ME, Britton BG. Short term effects of methylphenidate on thecognitive learning and academic performance of children with attention deficit disorder in thelaboratory and the classroom. J Child Psychol Psychiatry 1986;27(2):191-211.

Douglas VI, Barr RG, Amin K, O'Neill ME, Britton BG. Dosage effects and individualresponsibility to methylphenidate in attention deficit disorder. J Child Psychol Psychiatry1988;29(4):453-475.

Dubey DR, O'Leary SG, Kaufman KF. Training parents of hyperactive children in childmanagement: a comparative outcome study. J Abnorm Child Psychol 1983;11(2):229-46.

Dupaul GJ, Barkley R, McMurray M. Response of children with attention-deficit hyperactivitydisorder to methylphenidate: interaction with internalizing symptoms. J Am Acad Child AdolescPsychiatry 1994;33: 894-903.

DuPaul GJ, Rapport MD. Does methylphenidate normalize the classroom performance of childrenwith attention deficit disorder?. J Am Acad Child Adolesc Psychiatry 1993;32(1):190-99.

Elia J, Welsh PA, Gullotta CS, Rapoport JL. Classroom academic performance: improvementwith both methylphenidate and dextroamphetamine in attention-deficit hyperactivity disorderboys. J Child Psychol Psychiatry 1993;34(5):785-804.

Elia J, Borcherding BG, Rapoport JL, Keysor CS. Methylphenidate and dextroamphetaminetreatments of hyperactivity: are there true nonresponders? Psychiatry Research 1991;36(2):141-55.

Elia J, Borcherding BG, Potter WZ, Mefford IN, Rapoport JL, Keysor CS. Stimulant drugtreatment of hyperactivity: biochemical correlates. Clin Pharmacol Ther 1990;48(1):57-66.

Evans SW, Pelham WE. Psychostimulant effects on academic and behavioral measures forattention-deficit hyperactivity disorder junior high school students in a lecture format classroom. JAbnorm Child Psychol 1991;19(5):537-52.

Everett J, Thomas J, Cote F, Levesque J, Michaud D. Cognitive effects of psychostimulantmedication in hyperactive children. Child Psychiatry Hum Dev 1991;22(2):79-87.

Page 117: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Fehlings DL, Roberts W, Humphries T, Dawe G. Attention-deficit hyperactivity disorder: doescognitive behavioral therapy improve home behavior? J Dev Behav Pediatr 1991;12(4):223-8.

Fine S, Johnston C. Drug and placebo side effects in methylphenidate-placebo trial for attentiondeficit hyperactivity disorder. Child Psychiatry Hum Dev 1993;24(1):25-30.

Firestone P, Kelly M-J, Goodman JT, Davey J. Differential effects of parent training and stimulantmedication with hyperactives: a progress report. J Am Acad Child Psychiatry 1981;20(1):135-47.

Firestone P, Crowe D, Goodman JT, McGrath P. Vicissitudes of follow-up studies: differentialeffects of parent training and stimulant medication with hyperactives. Am J Orthopsychiatric1986;56(2):184-194.

Fischer M, Newby RF. Assessment of stimulant response in attention-deficit hyperactivitydisorder children using a refined multimethod clinical protocol. J Clin Child Psychol1991;20(3):232-44.

Fitzpatrick PA, Klorman R, Brumaghim JT, Borgstedt AD. Effects of sustained-release andstandard preparations of methylphenidate on attention-deficit disorder. J Am Acad Child AdolescPsychiatry 1992;31(2):226-34.

Fonagy P, Target M. The efficacy of psychoanalysis for children with disruptive disorders. J AmAcad Child Adolesc Psychiatry 1994;33(1):45-55.

Forness SR, Swanson JM, Cantwell DP, Youpa D, Hanna GL. Stimulant medication and readingperformance: follow-up on sustained dose in attention-deficit hyperactivity disorder boys with andwithout conduct disorders. J Learn Disabil 1992;25(2):115-123.

Forness SR, Swanson JM, Cantwell DP, Youpa D, Hanna GL. Differential effects of stimulantmedication on reading performance of boys with hyperactivity with and without conduct disorder. J Learn Disabil 1991;24(5):304-310.

Frankel F, Myatt R, Cantwell D, Feinberg DT. , Parent-assisted transfer of children=s social skillstraining: effects on children with and without attention-deficit hyperactivity disorder. J Am AcadChild Adolesc Psychiatry 1997;36(8):1056-1064.

Gadow KD, Nolan EE, Sverd J. Methylphenidate in hyperactive boys with comorbid tic disorder:II. Short-term behavioral effects in school settings. J Am Acad Child Adolesc Psychiatry1992;31(3):462-71.

Garfinkel BD, Webster CD, Sloman L. Responses to methylphenidate and varied doses ofcaffeine in children with attention deficit disorder. Can J Psychiatry 1981;26:395-401.

Garfinkel BD, Wender PH, Sloman L, et al. Tricyclic antidepressant and methylphenidate

Page 118: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

treatment of attention-deficit disorder in children. J Am Acad Child Psychiatry 1983;22:343-348.

Gordon M, Thomason D, Cooper S, Ivers CL. Nonmedical treatment of attention-deficithyperactivity disorder: the attention training system. J Sch Psychology 1991;29(2):151-9.

Greenhill LL, Cooper T, Solomon M, Fried J and Cornblatt B. Methylphenidate salivary levels inchildren. Psychopharmacol Bull 1987;23(1):115-119.

Grizenko N, Papineau D, Sayegh L. A comparison of day treatment and outpatient treatment forchildren with disruptive behavior problems. Can J Psychiatry 1993;38(6):432-5.

Grizenko N. Outcome of multimodal day treatment for children with severe behavior problems: afive-year follow-up. J Am Acad Child Adolesc Psychiatry 1997;36(7):989-97.

Gualtieri TC, Hicks RE, Mayo JP, Schroeder S. The persistence of stimulant effects in chronicallytreated children: further evidence of an inverse relationship between drug effects and placebolevels of response. Psychopharmacology 1984;83:44-47.

Hall CW, Kataria S. Effects of two treatment techniques on delay and vigilance tasks withattention deficit hyperactive disorder (ADHD) children. J Psychol 1992;126(1):17-25.

Heiligenstein E, Johnston HF, Nielsen JK. Pemoline therapy in college students with attentiondeficit hyperactivity disorder: a retrospective study. J Am Coll Health 1996;45(1):35-9.

Hinshaw SP, Henker B, Whalen CK, Erhardt D, Dunnington RE Jr. Aggressive, prosocial, andnonsocial behavior in hyperactive boys: dose effects of methylphenidate in naturalistic settings. JConsult Clin Psychol 1989;57(5):636-43.

Hinshaw SP, Buhrmester D, Heller T. Anger control in response to verbal provocation: effects ofstimulant medication for boys with attention-deficit hyperactivity disorder. J Abnorm ChildPsychol 1989;17(4);393-407.

Hinshaw SP, Henker B, Whalen CK. Cognitive-behavioral and pharmacologic interventions forhyperactive boys: comparative and combined effects. J Consult Clin Psychol 1984;52(5):750-8.

Hinshaw SP, Heller T, McHale JP. Covert antisocial behavior in boys with attention-deficithyperactivity disorder: external validation and effects of methylphenidate. J Consult Clin Psychol1992;60(2):274-81.

Hinshaw SP, Henker B, Whalen CK. Self-control in hyperactive boys in anger-inducing situations:effects of cognitive-behavioral training and of methylphenidate. J Abnorm Child Psychol1984;12(1):55-77.

Horn WF, Ialongo NS et al. Additive effects of behavioral parent training and self-control

Page 119: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

therapy with attention-deficit hyperactivity disorder children. J Clin Child Psychol 1990;19: 98-110.

Horn WF, Ialongo NS, Pascoe JM, Greenberg G, Packard T, Lopez M, Wagner A, Puttler L.Additive effects of psychostimulants, parent training, and self-control therapy with attention-deficit hyperactivity disorder children. J Am Acad Child Adolesc Psychiatry 1991;30(2):233-40.

Horn WF, Ialongo N, Popovich S, Peradotto D. Behavioral parent training and cognitive-behavioral self-control therapy with attention-deficit hyperactivity disorder children: comparativeand combined effects. J Clin Child Psychol 1987;16(1):57-68.

Ialongo NS, Horn WF et al. The effects of a multi-modal intervention with attention-deficithyperactivity disorder children: a 9 month follow-up. J Am Acad Child Adolesc Psychiatry 1993;32(1):182-189.

Johnston C, Pelham WE, Hoza J, Sturges J. Psychostimulant rebound in attention deficitdisordered boys. J Am Acad Child Adolesc Psychiatry, 1988;27(6):806-810.

Kaplan SL, Busner J, Kupietz S, Wassermann E, Segal B. Effects of methylphenidate onadolescents with aggressive conduct disorder and attention-deficit hyperactivity disorder: apreliminary report. J Am Acad Child Adolesc Psychiatry 1990;29(5):718-23.

Kayser KH, Wacker DP, Derby KM, Andelman MS, Golonka Z, Stoner EA. A rapid method forevaluating the necessity for both a behavioral intervention and methylphenidate. J Appl BehavAnal 1997;30(1):177-80.

Kelly PC, Cohen ML, Walker WO, Caskey OL, Atkinson AW. Self-esteem in children medicallymanaged for attention deficit disorder. Pediatrics 1989;83(2):211-7.

Kent JD, Blader JC, Koplewicz HS, Abikoff H, Foley CA. Effects of late-afternoonmethylphenidate administration on behavior and sleep in attention-deficit hyperactivity disorder.Pediatrics 1995;96(2):320-5.

Kessler S. Drug therapy in attention-deficit hyperactivity disorder. Am J Hum Genet1995;56(4):993-8.

Klein RG. Effects of high methylphenidate doses on the cognitive performance of hyperactivechildren. Bratisl Lek Listy 1991;92(11):534-9.

Klorman R, Brumaghim JT, Fitzpatrick PA, Borgstedt AD, Strauss J. Clinical and cognitiveeffects of methylphenidate on children with attention deficit disorder as a function ofaggression/oppositionality and age. J Abnorm Psychol 1994;103(2):206-221.

Klorman R, Brumaghim JT, Fitzpatrick PA, Borgstedt AD. Clinical effects of a controlled trial of

Page 120: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

methylphenidate on adolescents with attention deficit disorder. J Am Acad Child AdolescPsychiatry 1990;29(5):702-9.

Klorman R, Coons HW, Borgstedt AD. Effects of methylphenidate on adolescents with achildhood history of attention deficit disorder: I. Clinical findings. J Am Acad Child AdolescPsychiatry 1987;26(5):363-7.

Klorman R, Brumaghim JT, Fitzpatrick PA, Borgstedt AD. Methylphenidate speeds evaluationprocesses of attention deficit disorder adolescents during a continuous performance test. JAbnorm Child Psychol 1991;19(3):263-83.

Klorman R, Brumaghim JT, Salzman LF, Strauss J, Borgstedt AD, McBride MC, Loeb S. Effectsof methylphenidate on attention-deficit hyperactivity disorder with and withoutaggressive/noncompliant features. J Abnorm Psychol 1988;97(4):413-22.

Klorman R, Brumaghim JT et al. Comparative effects of methylphenidate on attention-deficithyperactivity disorder with and without aggressive/noncompliant features. Psychopharmacol Bull1989;25:109-113.

Kolko DJ, Loar LL, Sturnick D. In-patient social-cognitive skills training groups with conductdisordered and attention deficit disordered children. J Child Psychol Psychiatry Allied Disciplines 1990;31(5):737-748.

Krusch DA, Klorman R, Brumaghim JT, Fitzpatrick PA, Borgstedt AD, Strauss J.Methylphenidate slows reactions of children with attention deficit disorder during and after anerror. J Abnorm Child Psychol 1996;24(5):633-50.

Linden M, Habib T, Radojevic V. A controlled study of the effects of EEG biofeedback oncognition and behavior of children with attention deficit disorder and learning disabilities.Biofeedback Self Regul 1996;21(1):35-49.

Long N, Ricert VI, Ashcraft EW. Bibliotherapy as an adjunct to stimulant medication in thetreatment of attention-deficit treatment of attention-deficit hyperactivity disorder. J Pediatr HealthCare 1993;7(2):82-8.

Lubar JF, Smartwood MO, Smartwood JN, O'Donnell PH. Evaluation of the effectiveness ofEEG neurofeedback training for attention-deficit hyperactivity disorder in a clinical setting asmeasured by changes in T.O.V.A. scores, behavioral ratings, and WISC-R performance.Biofeedback Self Regul 1995;20(1):83-99.

Malone MA, Swanson JM. Effects of methylphenidate on impulsive responding in children withattention-deficit hyperactivity disorder. J Child Neurol 1993;8(2):157-63.

Martin CA, Vore M, Potts BD, Kryscio RJ, Norton JC, Madigan JM, Welsh RJ, Heffron WM,

Page 121: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Liu JP. Methylphenidate plasma concentrations in chronically and acutely treated latency-agechildren. Pharmacology 1989;39:46-49.

Mattes JA, Boswell L, Oliver H. Methylphenidate effects on symptoms of attention deficitdisorder in adults. Arch Gen Psychiatry 1984;41(11):1059-63.

Mayes SD, Crites DL, Bixler EO, Humphrey FJ II, Mattison RE. Methylphenidate and attention-deficit hyperactivity disorder: influence of age, IQ, and neurodevelopmental status. Dev MedChild Neurol 1994;36(12):1099-107.

McBride MC. An individual double-blind crossover trial for assessing methylphenidate responsein children with attention deficit disorder. J Pediatrics, 1988;113(1, 1):137-145.

Milich R, Carlson CL, Pelham WE Jr, Licht BG. Effects of methylphenidate on the persistence ofattention-deficit hyperactivity disorder boys following failure experiences. J Abnorm ChildPsychol 1991;19(5):519-36.

Musten M, Firestone P, Bennett S, Mercer J. Effects of methylphenidate on preschool childrenwith attention-deficit hyperactivity disorder: cognitive and behavioral functions. J Am Acad ChildAdolesc Psychiatry 1997;36(10):1407-1415.

Noland CS, Clement PW. Effects of self-reinforcement and stimulants on academic performancein children with attention deficit disorder. J Clin Child Psychol 1985;14(4):323-333.

O'Toole K, Abramowitz A, Morris R, Dulcan M. Effects of methylphenidate on attention andnonverbal learning in children with attention-deficit hyperactivity disorder. J Am Acad ChildAdolesc Psychiatry 1997;36(4):531-8.

Pelham WE, Walker JL, Sturges J, Hoza J. Comparative effects of methylphenidate on attention-deficit disorder girls and attention-deficit disorder boys. J Am Acad Child Adolesc Psychiatry1989;28(5):773-6.

Pelham WE, Vannatta K, Murphy DA, Milich R, Licht BG. Methylphenidate and attributions inboys with attention-deficit hyperactivity disorder. J Consul Clin Psychol 1992;60(2):282-92.

Pelham WE, Bender ME, Caddell J, Booth S, Moorer SH. Methylphenidate and children withattention deficit disorder: dose effects on classroom academic and social behavior. Arch GenPsychiatry 1985;42(10):948-52.

Pelham WE, Swanson JM, Furman MB, Schwindt H. Pemoline effects on children with attention-deficit hyperactivity disorder: a time-response by dose-response analysis on classroom measures. JAm Acad Child Adolesc Psychiatry 1995;34(11):1504-13.

Pelham WE, Greenslade KE, Vodde-Hamilton M, Greenstein JJ, Gnagy EM, Guthrie KJ, Hoover

Page 122: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

MD, Dahl RE. Relative efficacy of long-acting stimulants on children with attention deficit-hyperactivity disorder: a comparison of standard methylphenidate, sustained-releasemethylphenidate, sustained-release dextroamphetemine, and pemoline. Pediatrics 1990;86(2):226-37.

Pelham WE, Sturges J, Hoza J, Schmidt C, Bijlsma JJ, Milich R, Moorer S. Sustained release andstandard methylphenidate effects on cognitive and social behavior in children with attention deficitdisorder. Pediatrics 1987;80(4):491-501.

Pelham WE Jr, McBurnett K, Harper GW, Milich R, Murphy DA, Clinton J, Thiele C.Methylphenidate and baseball playing in attention-deficit hyperactivity disorder children: who's onfirst?. J Consult Clin Psychol 1990;58(1):130-3.

Pelham WE Jr, Carlson C, Sams SE, Vallano G, Dixon MJ, Hoza B. Separate and combinedeffects of methylphenidate and behavior modification on boys with attention deficit-hyperactivitydisorder in the classroom. J Consult Clin Psychol 1993;61(3):506-15.

Pelham WE, Hoza J. Behavioral assessment of psychostimulant effects on attention-deficitdisorder children in a summer day treatment program. In: Prinz R (ed.) Advances in behavioralassessment of children and families. 1987;3:3-33. (Greenwich CT: JAI Press)

Pelham WE et al. The effects of methylphenidate on attention-deficit hyperactivity disorderadolescents in recreations, peer groups, and classroom settings. J Clin Child Psychol 1991; 20:293-300.

Pisterman S, McGrath P, Firestone P, Goodman JT, Webster I and Mallory R. Outcome ofparent-mediated treatment of preschoolers with attention deficit disorder with hyperactivity. JConsult Clin Psychol, 1989;57(5):628-635.

Pisterman S, Firestone P, McGrath P, Goodman JT, Webster I, Mallory R and Goffin B. Therole of parent training in treatment of preschoolers with attention-deficit hyperactivity disorder.Am J Orthopsychiatric 1992;62(3):307-409.

Pliszka SR. Effect of anxiety on cognition, behavior, and stimulant response in attention-deficithyperactivity disorder. J Am Acad Child Adolesc Psychiatry 1989;28(6):882-7.

Pollard S, Ward EM, Barkley RA. The effects of parent training and ritalin on the parent-childinteractions of hyperactive boys. Child Family Behav Therapy 1983;5(4):51-69.

Potashkin BD, Beckles N. Relative efficacy of Ritalin and biofeedback treatments in themanagement of hyperactivity. Biofeedback Self Regul 1990;15(4):305-315.

Rapport MD, Denney C. Titrating methylphenidate in children with attention-deficit/hyperactivitydisorder: is body mass predictive of clinical response? J Am Acad Child Adolesc Psychiatry

Page 123: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

1997;36(4):523-530.

Rapport MD, Stoner G, DuPaul GJ, Kelly KL, Tucker SB, Schoeler T. Attention deficit disorderand methylphenidate: a multilevel analysis of dose-response effects on children's impulsivity acrosssettings. J Am Acad Child Adolesc Psychiatry 1988;27(1):60-9.

Rapport MD, Jones JT, DuPaul GJ, Kelly KL, Gardner MJ, Tucker SB, Shea MS. Attentiondeficit disorder and methylphenidate: group and single-subject analyses of dose effects onattention in clinic and classroom settings. J Clin Child Psychol 1987;16(4):329-38.

Rapport MD, Denney C, DuPaul GJ, Gardner MJ. Attention deficit disorder and methylphenidatenormalization rates, clinical effectiveness, and response prediction in 76 children. J Am AcadChild Adolesc Psychiatry 1994;33(6):882-93.

Rapport MD, Quinn SO, DuPaul GJ, Quinn EP, Kelly KL. Attention deficit disorder withhyperactivity and methylphenidate: the effects of dose and mastery level on children's learningperformance. J Abnorm Child Psychol 1989;17(6):669-89.

Rapport MD, DuPaul GJ, Stoner G, Birmingham BK, Masse G. Attention deficit disorder withhyperactivity: differential effects of methylphenidate on impulsivity. Pediatrics 1985;76(6):938-43.

Rapport MD, DuPaul GJ, Stoner G, Jones JT. Comparing classroom and clinic measures ofattention deficit disorder: differential, idiosyncratic, and dose-response effects of methylphenidate.J Consult Clin Psychol 1986;54(3):334-41.

Rapport MD, Carlson GA, Kelly KL, Pataki C. Methylphenidate and desipramine in hospitalizedchildren: I. Separate and combined effects on cognitive function. J Am Acad Child AdolescPsychiatry 1993;32(2):333-42.

Rapport MD, Stoner G, DuPaul GJ, Birmingham BK, Tucker S. Methylphenidate in hyperactivechildren: differential effects of dose on academic, learning, and social behavior. J Abnorm ChildPsychol 1985;13(2):227-44.

Rapport MD, DuPaul GJ. Methylphenidate: rate-dependent effects on hyperactivity.Psychopharmacol Bull 1985;21(1):223-8.

Rapport MD, Dupaul GJ and Kelly KL. Attention deficit hyperactivity disorder andmethylphenidate: the relationship between gross body weight and drug response in children.Psychopharmacol Bull 1989;25(2):285-290.

Reid MK, Borkowski JG. Effects of methylphenidate (Ritalin) on information processing inhyperactive children. J Abnorm Child Psychol 1984;12(1):169-86.

Resnick RJ, Hamer RM, Goldberg SC. Attention deficit disorder without hyperactivity: a

Page 124: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

preliminary investigation. Psychother Private Practice 1988;6(2):1-11.

Richardson E, Kupietz SS, Winsberg BG, Maitinsky S, Mendell N. Effects of methylphenidatedosage in hyperactive reading-disabled children: II. Reading Achievement. J Am Acad ChildAdolesc Psychiatry 1988;27(1):78-87.

Safer DJ, Allen RP. Absence of tolerance to the behavioral effects of methylphenidate inhyperactive and inattentive children. Pediatric Pharmacol Therapeutics 1989;115(6):1003-1008.

Sallee FR, Stiller RL, Perel JM. Pharmacodynamics of pemoline in attention deficit disorder withhyperactivity. J Am Acad Child Adolesc Psychiatry 1992;31(2):244-51.

Satterfield, JH, Satterfield BT and Cantwell DP. Three-year multimodality treatment study of 100hyperactive boys. J Pediatrics 1981;98(4):650-655.

Schachar RJ, Tannock R, Cunningham C, Corkum PV. Behavioral, situational and temporaleffects of treatment of attention-deficit hyperactivity disorder with methylphenidate. J Am AcadChild Adolesc Psychiatry 1997;36(6):754-763.

Schachar RJ, Taylor E, Wieselberg M, Thorley G, Rutter M. Changes in family function andrelationships in children who respond to methylphenidate. J Am Acad Child Adolesc Psychiatry1987;26(5):728-732.

Sebrects MM, Shaywitz SE, Shaywitz BA, Jatlow P, Anderson GM, Cohen DJ. Components ofattention, methylphenidate dosage, and blood levels in children with attention deficit disorder.Pediatrics 1986;77(2):222-8.

Shaywitz BA, Shaywitz SE, Sebrechts MM, Anderson GM, Cohen DJ, Jatlow P, Young JG.Growth hormone and proclactin response to methylphenidate in children with attention deficitdisorder. Life Sci 1990;46(9):625-33.

Shaywitz SE, Hunt RD, Jatlow P, Cohen DJ, Young JG, Pierce RN, Anderson G, Shaywitz BA.Psychopharmacology of attention deficit disorder: pharmacokinetic, neuroendocrine, andbehavioral measures following acute and chronic treatment with methylphenidate. Pediatrics1982;69(6):688-694.

Shekum WO, Bylund DB, Hodges K, Glaser R, Ray-Prenger C, Oetting G. Platelet alpha 2-andrenergic receptor binding and the effects of D-amphetamine in boys with attention deficitdisorder. Neuropsychobiology 1994;29(3):120-4.

Solanto MV, Wender EH. Does methylphenidate constrict cognitive functioning? J Am AcadChild Adolesc Psychiatry 1989;28(6):897-902.

Solanto MV, Conners CK. A dose-response and time-action analysis of autonomic and behavioral

Page 125: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

effects of methylphenidate in attention deficit disorder with hyperactivity. Psychophysiology1982;19(6):658-65.

Spencer T, Wilens T, Biederman J, Faraone SV, Ablon JS, Lapey K. A double-blind, crossovercomparison of methylphenidate and placebo in adults with childhood-onset attention-deficithyperactivity disorder. Arch Gen Psychiatry 1995;52(6):434-43.

Sprafkin J, Gadow KD. Double-blind versus open evaluations of stimulant drug response inchildren with attention-deficit hyperactivity disorder. J Child Adolesc Psychopharmacology1996;6(4):215-228.

Stein MA, Blondis TA, Schnitzler ER, O'Brian T, Fishkin J, Blackwell B, Szumowski E, RoizenNJ. Methylphenidate dosing: twice daily versus three times daily. Pediatrics 1996;98(4):748-56.

Stephens RS, Pelham WE, Skinner R. State-dependent and main effects of methylphenidate andpemoline on paired-associate learning and spelling in hyperactive children. J Consult Clin Psychol1984;52(1):104-13.

Strayhorn JM, Weidman CS. Follow-up one year after parent-child interaction training: effects onbehavior of preschool children. J Am Acad Child Adolesc Psychiatry 1991;30(1):138-43.

Strayhorn JM, Weidman CS. Reduction of attention deficit and internalizing symptoms inpreschoolers through parent-child interaction training. J Am Acad Child Adolesc Psychiatry1989;28(6):888-96.

Swanson JM, Sandman CA, Deutsch C, Baren M. Methylphenidate hydrochloride given with orbefore breakfast: I. Behavioral, cognitive, and electrophysiologic effects. Pediatrics 1983;72:49-55.

Swanson JM, Cantwell D, Lerner M, McBurnett K, Hanna G. Effects of stimulant medication onlearning in children with attention-deficit hyperactivity disorder. J Learn Disabil 1991;24(4):219-30.

Syrigou-Papavasiliou, Lycaki H, LeWitt PA, Verma N, Spivak D, Chayasirisobhon S. Dose-response effects of chronic methylphenidate administration on late event-related potentials inattention deficit disorder. Clinical Electroencephalography 1988;19(3):129-133.

Tannock R, Schachar RJ, Carr RP, Logan GD. Dose-response effects of methylphenidate onacademic performance and overt behavior in hyperactive children. Pediatrics 1989;84:648-657.

Tannock R, Ickowicz A, Schachar R. Differential effects of methylphenidate on working memoryin attention-deficit hyperactivity disorder children with and without comorbid anxiety. J Am AcadChild Adolesc Psychiatry 1995;34(7):886-96.

Page 126: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Tannock R, Schachar R, Logan G. Methylphenidate and cognitive flexibility: dissociated doseeffects in hyperactive children. J Abnorm Child Psychol 1995;23(2):235-65.

Tannock R, Schachar R. Methylphenidate and cognitive preservation in hyperactive children. JChild Psychol Psychiatry 1992;33(7):1217-28.

Taylor E, Schachar R, Thorley G, Wieselberg HM, Everitt B, Rutter M. Which boys respond tostimulant medication? A controlled trial of methyphenidate in boys with disruptive behavior.Psychol Med 1987;17(1):121-43.

Taylor MJ, Voros JG, Logan WJ, Malone MA. Changes in event-related potentials with stimulantmedication in children with attention deficit hyperactivity disorder. Biol Psychol 1993;36(3):139-56.

Thurston LP. Comparison of the effects of parent training and of Ritalin in treating hyperactivechildren. In: Strategic Interventions for Hyperactive Children. Gittelman E (ed.) New York:Sharpe ME. Pp. 178-185.

Tirosh E, Elhasid R, Kamah S, Cohen A. Predictive value of placebo methyphenidate. PediatrNeurol 1993; 9:131-133.

Trommer BL, Hoeppner J-A, Zecker SG. The go-no go test in attention deficit disorder issensitive to methylphenidate. J Child Neurol 1991;6(Suppl):S126-S129.

Truhlicka M. An investigation of the effects of behavior therapy versus drug therapy in thetreatment of hyperactive children. J Special Educators 1982;18(4)35-40.

Ullmann RK, Sleater EK. Responders, nonresponders, and placebo responders among childrenwith attention deficit disorders. Importance of a blinded placebo evaluation. Clin Pedatr1986;25(12):594-9.

Ullman RK, Sleator EK. Attention deficit disorder children with or without hyperactivity: whichbehaviors are helped by stimulants? Clinical Pediatr (Phila) 1985;24:547-551.

Varley CK, Trupin EW. Double-blind assessment of stimulant medication for attention deficitdisorder: a model for clinical application. Am J Orthopsychiatry 1983;53(3):542-547.

Varley CK. Effects of methylphenidate in adolescents with attention deficit disorder. J Am AcadChild Psychiatry 1983;22(4):351-4.

Vyse SA, Rapport MD. The effects of methylphenidate on learning in children with attention-deficit hyperactivity disorder: the stimulus equivalence paradigm. J Consult Clin Psychol1989;57(3):425-35.

Page 127: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Wender PH, Reimherr FW, Wood DR. Attention deficit disorder ('minimal brain dysfunction') inadults: a replication study of diagnosis and drug treatment. Arch Gen Psychiatry 1981;38(4):449-56.

Wender PH, Reimherr FW, Wood DR et al. A controlled study of methylphenidate in thetreatment of attention deficit disorder, residual type in adults. Am J Psychiatry 1985;142:547-552.

Werry JS, Scaletti R, Mills R. Sensory integration and teacher-judged learning problems: acontrolled intervention trial. J Paediatrics Child Health 1990;26(1):31-35.

Whalen CK, Henker B, Buhrmester D, Hinshaw SP, Huber A, Laski K. Does stimulantmedication improve the peer status of hyperactive children? J Consult Clin Psychol1989;57(4):545-9.

Whalen CK, Henker B, Finck D. Medication effects in the classroom: three naturalistic indicators.J Abnorm Child Psychol 1981;9(4):419-33.

Whalen CK, Henker B, Swanson JM, Granger D, Kliewer W, Spencer J. Natural social behaviorsin hyperactive children: dose effects of methylphenidate. J Consult Clin Psychol 1987;55(2):187-93.

Whalen CK, Henker B, Granger DA. Social judgment processes in hyperactive boys: effects ofmethylphenidate and comparisons with normal peers. J Abnorm Child Psychol 199l;18(3):297-316.

Whalen CK, Henker B, Granger DA. Ratings of medication effects in hyperactive children: viableor vulnerable? Behavioral Assessment 1989;11:179-199.

Wilkison PC, Kircher JC, McMahon WM, Sloane HN. Effects of methylphenidate on rewardstrength in boys with attention deficit hyperactivity disorder. J Am Acad Child Adolesc Psychiatry1995;34(7):897-901.

Williams RA, Horn S, Daley SP, Nader PR. Evaluation of access to care and medical andbehavioral outcomes in a school-based intervention program for attention-deficit hyperactivitydisorder. J Sch Health 1993;63(7):294-7.

Winsberg BG, Kupietz SS, Sverd J. Methylphenidate oral dose plasma concentrations andbehavioral response in children. Psychopharmacology 1982;70:329-332.

Winsberg B, Matinsky S, Kupietz S, Richardson E. Is there dose-dependent tolerance associatedwith chronic methylphenidate therapy in hyperactive children: oral dose and plasmaconsiderations. Psychopharmacology 1987;23(1):107-110.

Page 128: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Yellin AM, Hopwood JH, Greenberg LM. Adults and adolescents with attention deficit disorder:clinical and behavioral responses to psychostimulants. J Clin Psychopharmacol 1982;2(2):133-6.

Zametkin A, Rapoport JL, Murphy DL, Linnoila M, Ismond D. Treatment of hyperactive childrenwith monoamine oxidase inhibitors: I. Clinical efficacy. Arch Gen Psychiatry 1985;42(10):962-6.

Zametkin AJ, Reeves JC, Webster L, Werry JS. Promethazine treatment of children withattention deficit disorder with hyperactivity-ineffective and unpleasant. J Am Acad ChildPsychiatry 1986;25(6):854-856.

Zametkin AJ, Hamburger SD. The effects of methylphenidate on urinary catecholamine excretionin hyperactivity: a partial replication. Biol Psychiatry 1988;23:350-6.

Zametkin AJ, Linnoila M, Karoum F, Sallee R. Pemoline and urinary excretion of catecholaminesand indoleamines in children with attention deficit disorder. Am J Psychiatry 1986;3(3):359-62.

Page 129: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Appendix 4: Studies in Database of Intervention Effects

Amery B, Minichiello MD, Brown GI. Aggression in hyperactive boys: response to D-amphetamine. J Am Acad Child Psychiatry 1984;23(3):291-4.

Arnold LE, Kleykamp D, Votolato NA, Taylor WA, Kontras SB, Tobin K. Gamma-linolenic acidfor attention-deficit hyperactivity disorder: placebo-controlled comparison to D-amphetamine.Biol Psychiatry 1989 Jan; 25(2):222-8.

Barkley RA, Karlsson J, Pollard S, Murphy JV. Developmental changes in the mother-childinteractions of hyperactive boys: effects of two dose levels of ritalin. J Child Psychol Psychiatry1985 Sept;26(5):705-15.

Bloomquist ML, August GJ, Ostrander R. Effects of a school-based cognitive-behavioralintervention for ADHD children. J of Abnormal Child Psychology 1991;19(5):591-605.

Brown RT, Sexson SB. A controlled trial of methylphenidate in black adolescents. Attentional,behavioral, and physiological effects. Clin Pediatr 1988 Feb;27(2):74-81.

Brown RT, Wynne ME, Borden KA, Clingerman SR, Geniesse R, Spunt AL. Methylphenidateand cognitive therapy in children with attention deficit disorder: a double-blind trial. J Dev BehavPediatr 1986;7(3):163-74.

Brown RT, Wynne ME, Medenis. Methylphenidate and cognitive therapy: a comparison oftreatment approaches with hyperactive boys. J Abnormal Child Psychology 1985;13:69-87.

Buitelaar JK, Van der Gaag R, Swaab-Barneveld H, Kuiper M. Pindolol and methylphenidate inchildren with attention-deficit hyperactivity disorder: clinical efficacy and side-effects. J ChildPsychol Psychiatry 1996;37(5):587-95.

Donnelly M, Rapoport JL, Potter WZ, Oliver J, Keysor CS, Murphy DL. Fenfluramine anddextroamphetamine treatment of childhood hyperactivity: clinical and biochemical findings. ArchGen Psychiatry 1989 Mar;46(3):205-12.

Dupaul GJ, Barkley R, McMurray M. Response of children with ADHD to methylphenidate:interaction with internalizing symptoms. J Am Acad Child Psychiatry 1994;33:894-903.

DuPaul GJ, Rapport MD. Does methylphenidate normalize the classroom performance of childrenwith attention deficit disorder?. J Am Acad Child Adolesc Psychiatry 1993 Jan;32(1):190-99.

Evans SW, Pelham WE. Psychostimulant effects on academic and behavioral measures for ADHDjunior high school students in a lecture format classroom. J Abnorm Child Psychol1991;19(5):537-52.

Page 130: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Fehlings DL, Roberts W, Humphries T, Dawe G. Attention deficit hyperactivity disorder: doescognitive behavioral therapy improve home behavior? J Dev Behav Pediatr 1991 Aug;12(4):223-8.

Firestone P, Crowe D, Goodman JT, McGrath P. Vicissitudes of follow-up studies: differentialeffects of parent training and stimulant medication with hyperactives. Am J Orthopsychiatry,1986;56(2):184-94.

Fischer M, Newby RF. Assessment of stimulant response in ADHD children using a refinedmultimethod clinical protocol. J Clin Child Psychol 1991;20(3):232-44.

Fitzpatrick PA, Klorman R, Brumaghim JT, Borgstedt AD. Effects of sustained-release andstandard preparations of methylphenidate on attention deficit disorder. J Am Acad Child AdolescPsychiatry 1992;31(2):226-34.

Klorman R, Brumaghim JT, Fitzpatrick PA, Borgstedt AD, Strauss J. Clinical and cognitiveeffects of methylphenidate on children with attention deficit disorder as a function of aggression /oppositionality and age. J Abnorm Psychol 1994;103(2):206-21.

McBride MC. An individual double-blind crossover trial for assessing methylphenidate responsein children with attention deficit disorder. J of Ped 1988;113(1, part 1):137-45.

Musten M, Firestone P, Bennett S, Mercer J. Effects of Methylphenidate on Preschool Childrenwith ADHD: Cognitive and Behavioral Functions. J Am Acad Child Adolesc Psychiatry1997;36(10):1407-15.

Pelham WE, Swanson JM, Furman MB, Schwindt H. Pemoline effects on children with ADHD: atime-response by dose-response analysis on classroom measures. J Am Acad Child AdolescPsychiatry 1995;34(11):1504-13.

Rapport MD, DuPaul GJ, Kelly KL. Attention deficit hyperactivity disorder and methylphenidate:the relationship between gross body weight and drug response in children. PsychopharmacologyBulletin 1989;25(2):285-90.

Rapport MD, Jones JT, DuPaul GJ, Kelly KL, Gardner MJ, Tucker SB, Shea MS. Attentiondeficit disorder and methylphenidate: group and single-subject analyses of dose effects onattention in clinic and classroom settings. J Clin Child Psychol 1987;16(4):329-38.

Schachar RJ, Tannock R, Cunningham C, Corkum PV. Behavioral, situational and temporaleffects of treatment of ADHD with methylphenidate. J Am Acad Child Adolesc Psychiatry1997;36(6):754-763.

Stein MA, Blondis TA, Schnitzler ER, O'Brian T, Fishkin J, Blackwell B, Szumowski E, RoizenNJ. Methylphenidate dosing: twice daily versus three times daily. Pediatrics 1996 Oct;98(4):748-

Page 131: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

A REVIEW OF THERAPIES FOR ATTENTION DEFICIT/

HYPERACTIVITY DISORDER

56.

Tirosh E, Elhasid R, Kamah S, Cohen A. Predictive value of placebo methylphenidate. PediatrNeurol 1993;9:131-133.

Zametkin A, Rapoport JL, Murphy DL, Linnoila M, Ismond D. Treatment of hyperactive childrenwith monoamine oxidase inhibitors: I. Clinical efficacy. Arch Gen Psychiatry 1985;42(10):962-6.

Page 132: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Part 3: Economic evaluation of pharmaceutical andpsychological/behavioural therapies for attention-deficit/hyperactivity disorder

John A. F. Zupancic, MD, MS, FRCPCAnton Miller, MB.ChB., FRCPC

Parminder Raina, PhD.Shoo K. Lee, MB.BS., PhD., FRCPC

Anne Klassen, D PhilLise Olsen, BSN, MPH

Page 133: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

1. Introduction1.1 Attention Deficit DisorderAttention deficit hyperactivity disorder (ADHD) is estimated to affect 3% - 5% of school-agechildren.1 Clinical manifestations of the diagnosis include impulsive behavior, increased task-inappropriate motor activity, and difficulties in regulating attention to meet task demands. Children commonly exhibit disruptive behavior in the classroom, academic underachievement andconflictual peer and family relations. ADHD is also frequently associated withneurodevelopmental and psychiatric disturbances such as learning, anxiety and conduct disorders.

Management strategies broadly consist of (a) medicating the child to reduce the frequency andintensity of problematic behaviors and to allow the child to achieve better self-control and betterregulation of attention to task; (b) educating parents and teachers about the nature of ADHDthereby allowing them to have realistic expectations of the child, providing them with simplestrategies to modify the child's environment to reduce behavior problems, and training them toacquire effective behavior management skills; and (c) psychological therapy with the child to teachhim/her self-control and self-monitoring skills. Other modalities of therapy may also be applieddepending on individual circumstances and needs, such as social skills training and academictutoring.

The high prevalence and educational impact of the disorder is reflected in the high rates ofprescription of the three most commonly used medications. However, there has been concernamong provincial payers that these patterns of prescription may not be clinically and economicallyappropriate. Moreover, there is interest in whether alternatives to drug therapy are effective andbeing used appropriately. The techniques of economic evaluation, partnered with themethodologies of systematic literature review and meta-analysis, provide an approach toevaluating and balancing effective care with the realities of economic constraint.

1.2 Product DescriptionThe stimulant class of medications, comprising methylphenidate hydrochloride (brand nameRitalin), dextroamphetamine sulfate (brand name Dexedrine) and magnesium pemoline (brandname Cylert) are the most widely-used form of medical management. All three act by increasinglevels of biogenic amines (norepinephrine, dopamine and serotonin) at the presynaptic cleft bymechanisms which include release of certain of these catecholamines and reuptake blockade ofothers. In North America, methylphenidate has been adopted by physicians as the mostfrequently-used Afirst-line@ drug, and is available in both proprietary (Ritalin, manufacturerNovartis) and generic form (manufacturer Pharmascience). Dexedrine (manufacturer SmithKlineBeecham) and Cylert (manufacturer Abbott) are not available generically.

Canadian prescription sales of these products for the year 1996 are 178 000,400 000, 84 000 and 43 000 prescriptions for methylphenidate generic, Ritalin, Dexedrine andCylert, respectively,2 and the vast majority (at least 80%) are for children and youth under 20years of age3 (see also Part 1 of this present series of reports) for whom ADHD is the principalindication.

Page 134: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

All three medications are associated with nuisance adverse effects such as appetite suppression,insomnia and anxiety, which may decrease compliance or necessitate discontinuation.4,13 pemolinemay be associated with a chemical hepatitis in up to 3% of cases5 but which is benign andreversible. A number of cases of pemoline-associated potentially fatal fulminant hepatic failurehave been reported.5,6,7 This seems to be a rare occurrence, and no data are available on itsincidence in the population. Some have questioned the causal nature of this association.8

Nevertheless, this phenomenon has not been reported for the other stimulant drugs, and the riskof its occurrence has led the manufacturer of pemoline to recommend against its use as a first-linetreatment for children and youth with ADHD.9 Serious adverse effects such as the emergence ofpermanent movement and tic disorders may be seen with all the stimulants and psychotic reactionswith dextroamphetamine and methylphenidate, but these are again very rare occurrences.

1.3 Study ObjectiveThe objective of the study was to compare the costs and clinical outcomes of five alternative modes of

treatment for ADHD, including three medication strategies, one non-medication strategy and onealternative combining medication and non-medication therapies. Outcomes were derived from themeta-analysis of published clinical trials described in Part 2 of the present series of reports andquantified in terms of differences in scores on behavioral rating scales. Decision analyticmethodology was used to structure the problem and to estimate expected costs and outcomes foreach alternative. Incremental cost-effectiveness analysis was performed on the resultingestimates.

1.4 Disclosure of RelationshipsThe study was completed under a contract with the Canadian Coordinating Office for HealthTechnology Assessment. The authors have no financial or contractual relationships with thepharmaceutical manufacturers of the drugs assessed.

2. Methods2.1 Type of AnalysesThe analysis was a retrospective assessment using data from the meta-analysis of publishedclinical trials described in Part 2 of the present series of reports, and panels representing expertsand community-based service providers who were consulted to provide information about currentpatterns, standards and costs of care in a number of communities across Canada (refer to theAppendix for details).

The problem was structured using the decision analytic tree shown in Figure 1. Five alternativestrategies, shown in the tree diagram (Figure 1) and detailed in Table 1, were compared. Theseincluded three drug therapies (pemoline, PEM; dextroamphetamine, DAS; methylphenidate,MPH) as well as one psychological/behavioural therapy (PSYCH/BEHAV) and one combinationtherapy (COMB) which included both methylphenidate and psychological/behavioural treatment. For each alternative, separate costs and effectiveness were estimated for full compliance or partialcompliance with therapy. Where appropriate, the costs and outcomes associated with severeadverse reactions to therapy were also estimated.

Page 135: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

In light of the potentially fatal consequences of pemoline use in this population, the analysis wasalso performed after excluding pemoline from consideration. This was thought to reflect moreclosely the practice of many clinicians, for whom the drug may not currently be considered atherapeutic alternative (see also Section 1.2 above).

Two levels of analysis were undertaken. First, a cost-consequence analysis derived individualdirect medical costs associated with the therapeutic alternatives, and the consequences in terms ofdifferences in mean scores on the behavioural rating scales (see Section 3.7).

These results were then aggregated in a cost-effectiveness analysis, in which each alternative wascompared to the next best strategy, and to the reference strategy of no treatment. Strategies forwhich the cost was higher for lower effect were eliminated by dominance, and the results reportedin terms of the incremental cost-effectiveness of each of the remaining strategies.

All analyses were performed using DATA 3.0.16 decision analysis software (TreeAge Software:Williamstown, Massachusetts; 1997).

2.2 Target AudienceThe target audience for this report is the Department of Health and private third-party payer. Although societal costs could not be estimated for the reasons outlined in Section 3.3, secondarytarget audiences will include educators, clinicians interested in economically prudent prescribing,and parents of the patients involved, who in many cases bear at least some portion of the directmedical costs of therapy.

2.3 ViewpointCosts were assessed from the perspective of a third party payer for health care andpharmaceuticals, specifically, the provincial and territorial ministries of health and their associateddrug benefit plans. Such a perspective considered all direct medical costs, including medication,physician visits and hospitalisation, but excluded spillover costs to the educational sector andcosts accruing to the family. It should be noted that costs for psychological therapies do accrueto families, except where such services are obtained in the public sector setting; however, in theinterest of consistency, this analysis made the simplifying assumption that these costs are borne bythe ministry.

Page 136: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

In light of the impact on the educational system of the large numbers of children with ADHD, anideal analysis would take a higher-level perspective. However, a provincial inter-ministry analysiswould have required data on educational costs associated with the treatment alternatives, andthese were unavailable either from the literature or from an informal survey of educators. Further,analysis from the societal viewpoint would have required data on indirect costs borne by parents(for example, time lost from work), which were also unavailable.

2.4 Treatment ComparatorThe alternatives specified represent all of the standard modes of therapy for ADHD. Since non-treatment is also undertaken in many instances, and since the effectiveness data were derived fromstudies involving comparison to a placebo, the do-nothing alternative was used as the initialtreatment comparator. Data on the natural history of health care use by children with ADHD arelacking. There are data to suggest that affected children have more accidents and injuries thanother children, but none to demonstrate that treatment of the condition reduces these untowardevents. In the absence of such data, this analysis assumes that untreated children have 4additional visits to the general practitioner per year relative to their unaffected peers (to maintaincomparability with drug strategies), with sensitivity analysis varying this number between 0 and 4.

2.5 Time HorizonThere are varying estimates of the average duration of treatment in ADHD. Data from the B.C.Methylphenidate Survey (Miller AR, Armstrong RW, Lalonde CE., unpublished) suggest that thecumulative duration for a school-aged child, allowing for breaks in medication use of severalmonths or more, and disregarding the significant minority of children who receive a singleprescription only, is approximately 18 months. However, when all prescriptees are considered,only about 35% of school-aged children continue to receive prescriptions for MPH six monthsafter commencing therapy. In the face of these considerations, we adopted a 1-year time horizonas a convenient compromise for the >typical= length of time that children remain on drugtreatment. Adverse drug reactions, beneficial effects and costs are all assumed to cease withdiscontinuation of therapy. There is also no proven decrease in drug effectiveness over time. Thisimplies that any change in length of drug therapy should result in proportional changes to bothcosts and effects, so that the results may be generalised to any time horizon. This may not applyequally to non-medical therapy, where the skills learned in early counselling sessions might beforgotten; in this case, longer time horizons than we presented would result in decreasedeffectiveness but constant costs.

2.6 Related Studies and BackgroundA complete systematic review of the literature related to the effectiveness of treatment strategiesfor ADHD, with a meta-analysis of clinical trials, is provided in Part 2 of the present series ofreports. There have been no studies of the economic ramifications of the disorder or itstreatment.

2.7 Outcome MeasurementThe meta-analysis in Part 2 of the present series of reports expressed treatment outcomes in terms

Page 137: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

of differences in mean scores on various behavioural rating scales completed by parents orteachers. Effectiveness outcomes of this economic evaluation are expressed as the meandifference between treatment and placebo groups/conditions for one such scale, the AbbreviatedConners Teacher Rating Scale (ACTRS). These values, along with the number of studies andaggregate sample size on which they are based, are summarised in Table 4.The choice of this scale over the others is related to the fact that it is common tostudies for all five alternatives assessed. In cases where these scales were similar across studiescompared, the results could be expressed as mean differences in scale score between treatmentand control groups, weighted by the inverse variance of the sample. However, where differentscales were used, it was necessary to express efficacy as an effect size, or standardised meandifference. As this result is more difficult to understand intuitively as part of the cost-effectiveness ratio, it was avoided, despite the fact that including it would have allowed theexpression of the effectiveness from the parents= viewpoint. A second reason is that, in asignificant proportion of cases, children with ADHD receive medical therapy for classroom-related behaviour problems, and they receive it only at school. In this situation, where effects onbehaviour are predominantly occurring at school, teachers= observations of behaviour are mostrelevant. A detailed presentation of the rationale behind the selection of the ACTRS as theprimary outcome measure in this study, as well as further description of this measure and itsadvantages and disadvantages, can be found in Part 2 of the present series of reports, underSection 1.1, pages 3 - 4. More important is the issue of expressing outcome using a continuous behaviour rating scale,which is in fact a surrogate outcome that must then be translated to a more clinically meaningfulmeasure. Unfortunately, the data presentation in the analysed studies precluded any other format. In an effort to make the results more intuitive, the cost-effectiveness ratios are presented not onlyas cost per point difference in mean Conner Teacher Rating Scale, but also as the cost for a sixpoint reduction. This corresponds to approximately one standard deviation in the distribution ofCTRS in the studies analysed, an affect size cited by other respected clinical investigators asrepresenting Aa valid and reliable indicator of changes (used to distinguish clinical response totreatments for ADHD)@.10

The use of a continuous rating scale as the denominator for the cost-effectiveness ratio requirestwo assumptions. First, the cost and desirability of achieving a small gain in CTRS score formany children is assumed to be the same as the cost and desirability of achieving a large gain forfew children. Secondly, it is assumed that the baseline severity does not affect the cost-effectiveness, so that a one-point decrease for a severely affected child has the same associatedcosts as a one-point decrease for a mildly affected child. Cost-utility analysis was not performed,as there are no available data on health Brelated quality of life for children with ADHD.

2.8 Effectiveness and Therapeutic ComplianceAvailable data on compliance with therapy are poor. The data available from Part 2 of this reportindicate only that, averaged across trials, 21% of subjects dropped out of medication therapyprematurely, but give no time course of patients= discontinuing medication therapy. The averageestimate by members of the main Expert Panel for children commenced on stimulant medicationstill to be taking it 6 and 12 months later was 86% and 75% respectively. On the other hand,extrapolation to six and twelve months from the four and ten month figures for subjects

Page 138: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

continuing on medication in a clinical trial context as reported by Firestone11 yields complianceestimates of 70% and 50% respectively. Finally, as mentioned in Section 2.5 above, analysesfrom the B.C Methylphenidate Survey for children receiving a prescription for MPH in apopulation context within the province during the years 1990 B1996 (including those who onlyreceive a single prescription) indicate that only 35% and 15% of school-aged childrenrespectively, continue to have prescriptions filled six and twelve months following initialprescription. We felt that the BC data comes closest to reflecting what is happening with attritionin the >real world= and felt that a six month frame was a relevant time to model attrition. It wasassumed for the purposes of the study that such children continued to attend follow-upappointments, but that drug costs and effects became zero after the point of non-compliance. Thepercentage of children discontinuing medication was varied over the full range of 0 to 100% insensitivity analyses.

2.9 Cost Measurement and ValuationIn order to measure costs, it was necessary to have information about clinical practice patternsand typical resource utilisation. As much of this information was not available in the literature,three expert panels, described in the Appendix were convened. The panels provided informationregarding therapeutic strategies, compliance and dosage regimens typically used in management ofthe index case, a 9 year old, 28-kg boy. They also provided information about the costs thatwould be involved in treating such a child (and family) in their particular communities.

Frequencies of physician visits were estimated from the time between prescriptions, based on theaverage of 90 tablets per prescription reported in survey and prescription data2 (also Miller AR,Armstrong RW and Lalonde CE: B.C. Methylphenidate Survey, unpublished). Frequency andtype of laboratory testing was based on published guidelines with the assumption that physiciansdo these tests according to those guidelines.7,9,12,13

Unit drug prices are shown in Table 2. Drug prices were obtained from Intercontinental MedicalStatistics (IMS)2 and represent national averages including dispensing fees and mark-ups. Fordrugs with generic equivalents, the baseline analysis was performed using the price for theproprietary product, and the generic price was introduced in sensitivity analysis.Costs for physician services are shown in Table 3. These costs are for follow-up visits averagedacross the provincial fee schedules for British Columbia, Ontario and Quebec. Only follow-upvisits were considered, as it was assumed that the initial diagnostic consultation had already takenplace at the time that a therapeutic decision was made, and that this diagnostic consultation wasconstant across all alternatives.

As discussed in more detail under Section 2.4 above, data on the health care utilisation of childrenwith untreated ADHD are lacking. For the purposes of this analysis, it was assumed thatuntreated children visited their family physicians four more times per year than their unaffectedpeers. This is the same number of visits per year assumed for drug therapy in this model.Costs of psychological/behavioural therapies, also given in Table 3, were averages of: (1)estimates given by members of the expert panel for the time of professionals who would be likelyto provide the services in their respective communities (including private practice or salariedpsychologists and behavioural consultants); (2) figures obtained from provincial Psychological

Page 139: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Associations for psychologist consultation; and (3) figures published in research reports ofpsychological/behavioural interventions in Canada.14

The cost of toxic hepatitis (Table 3) was generalised from recent data in the literature on thedirect medical costs of acute hepatitis B infection, converted to Canadian currency.15,16

Laboratory costs for complete blood count and liver function tests (Table 3) were obtained fromthe fee schedule for British Columbia Children=s Hospital.

Table 5 shows the calculation of the annual costs of treatment for each of the five alternatives, aswell as for the no-treatment comparator, under the base case assumptions.

All costs were expressed in 1997 Canadian dollars. Because both costs and effects of therapyoccurred in a continuous, monotonic stream, and because the time horizon was only one year,discounting was not applied.

2.10 UncertaintyThe impact of uncertainty was assessed using a series of sensitivity analyses for both costs andoutcomes. These included the following:

1. Generic formulation for methylphenidate.2. 95% confidence intervals for weighted mean difference in Conner Teacher Rating Scale.3. Severity of hepatitis, using costs associated with non-hospitalized hepatitis B, hospitalized

hepatitis B, and fulminant hepatitis B.4. Costs of physician and psychologist visits, by 20% in either direction, as this was assumed

to represent a maximum of the interprovincial variation in physician fees and of marketvariation in fees for private practice psychologists.

5. Medication during school days only.6. Compliance, expressed as the percent of patients who discontinue therapy because of

adverse effects without notifying their physicians7. A worst case analysis (with respect to pharmaceutical therapies) in which the upper

confidence intervals and lower costs for psychological/behavioral therapies are used, and thelower confidence intervals and higher costs for pharmaceutical therapies are used.

8. Weight of child.

2.11 Subgroup AnalysesNo subgroup analyses were performed.

2.12 Summary of Assumptions Model:_ Toxicity and non-compliance develop at 0.5 year._ Both costs of ADHD therapy and beneficial outcomes cease with onset of toxicity._ Serious adverse effects with incidence less than that of toxic hepatitis are not modeled._ With non-compliance, costs of monitoring continue but drug costs and beneficial effects

cease.

Page 140: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

_ Nuisance side effects such as insomnia and appetite suppression are not modeled; we aretherefore implicitly assuming that there are no direct medical costs associated with them.

_ The one-year time horizon does not introduce bias in the comparison of pharmaceutical andpsychological/behavioral strategies, through waning of the skills learned in counseling.

_ It is equally desirable to provide a small gain in Conner Teacher Rating Scale to many childrenor a large gain to a few.

Clinical:_ Improvement in scores on the Conner teacher rating scale is a good surrogate for clinically

significant improvement_ Improvement in scores on the Conner Teacher Rating Scale is independent of the pre-

treatment score._ The outcome data from pooled clinical trials accurately reflects the results that would be

obtained in head-to-head comparison of the five treatment strategies.

Economic:_ The estimates of resource utilization and psychological/behavioral therapy costs provided by

the expert panel accurately reflect the true values._ Alternative strategies exhibit perfect divisibility._ Costs of alternative strategies exhibit constant returns to scale.

3. Results3.1 Pemoline Excluded3.1.1 Base case analysisEstimates of the expected costs and expected outcomes of alternatives under the base caseassumptions, not including pemoline, are presented in Table 6 and graphically in Figure 6. DAS,PSYCH/BEHAV and COMB showed higher costs and smaller differences in CTRS scores thanthe other strategies: these were eliminated from further consideration by strict dominance.

Table 7 shows the incremental costs and effectiveness relative to the no-treatment comparator, aswell as the summary incremental cost-effectiveness, for the remaining strategies. As shown,methylphenidate therapy costs $83 for each point difference in the Conner Teacher Rating Scalescore sustained for one year.

Placing these values in terms of the clinically significant outcomes discussed earlier, a significant(6-point, or one standard deviation) improvement in outcome costs $498 with methylphenidate,when compared to the non-treatment alternative.

3.1.2 Sensitivity analysisThe basic finding, that methylphenidate therapy dominates other dextroamphetamine and the non-drug treatment strategies, generally remained robust through extensive sensitivity analyses. Table8 summarises the findings of one-way sensitivity analyses.

Page 141: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Increased or decreased physician and psychologist fees had no effect on the preference for MPHand minimal effects on its absolute cost-effectiveness ratio.

Similarly, varying the efficacy for each therapy individually to the limits of its 95% confidenceinterval had little effect. Most significantly, there was no change in dominance of pharmaceuticalover non-pharmaceutical therapies even when the upper confidence limit forpsychological/behavioural therapy (PSYCH/BEHAV) was used. Although COMB therapyceased to be dominated under its high confidence limit, it remained an inferior option to MPH.

Compliance was modelled as discontinuation of therapy without notification of the physician at 6months of therapy. It is assumed, then, that costs of monitoring continue while effects and drugcosts do not. Expected cost-effectiveness as a function of compliance with methylphenidatetherapy is shown in Figure 2. The threshold value is a compliance of 0.10, at which point DASbecomes the preferred option, with a cost-effectiveness of $120. Given the similar common side-effect profiles for three medications considered in this study, such a discrepancy in compliance isunlikely to occur.

As we had assumed a weight of 28 kg for the baseline analysis, it was possible thatpsychological/behavioural therapies would become more attractive as patient size increased, sincethe costs of counselling remain constant. However, the preference for MPH was unchanged inanalyses for a 16 kg or 40 kg child.

The expert panel also noted that most patients who are prescribed psychological/ behavioraltherapies do not receive as frequent counseling as those in research protocols. To test the impactof this less costly program, we decreased the number of therapy hours to the expert panelestimates of real-world practices (5, 9.5 and 1.3 hours for child, parent and teacher counselingrespectively), but made the assumption that the efficacy was undiminished. Under this liberalassumption, MPH remained the more cost-effective option.

Finally, a strong test of the dominance of MPH was undertaken in a worst-case analysis. In thisscenario, inputs were used that minimised efficacy and maximised costs for the pharmaceuticalstrategies, and the converse for the psychological/behavioural strategies. Although COMB thenbecame a non-dominated option, it remained less attractive than MPH.

3.2 Pemoline Included3.2.1 Base case analysisPemoline was included at two dosage levels, corresponding to the two regimens used in the trialthat entered the meta-analysis. As shown in Tables 9 and 10, and graphically in Figure 7,inclusion of pemoline at the lower dose (37.5 mg daily or 1.4 mg/kg/day for the index 28 kg child)resulted in strict dominance of the PEM strategy by MPH. Results were otherwise identical tothose for the analysis that excluded pemoline.

The results for the analysis including pemoline at the higher dose (75 mg daily or 2.8 mg/kg/day

Page 142: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

for the index 28 kg child) are shown in Tables 12 and 13 and in Figure 8. At this dose, PEM is nolonger dominated, but remains an inferior option compared to MPH, with a cost of $106 for eachpoint difference in the Conner Teacher Rating Scale score sustained for one year (compared to$83 for MPH), or $246 for each additional point difference in CTRS beyond that achieved byMPH. In terms of the clinically significant 6-point (one standard deviation) difference discussedearlier, PEM thus costs $636 for a clinically significant improvement or $1476 for each clinicallysignificant improvement beyond that which could be achieved by MPH.

3.2.2 Sensitivity analysisSensitivity analyses for the low dose pemoline strategy are shown in Table 11. The dominance ofMPH over the other strategies was maintained in almost all cases. The most notable exceptionoccurred when the effectiveness of pemoline was taken at its upper 95% confidence interval fromthe meta-analysis, in which case it dominated dextroamphetamine, combination and non-pharmaceutical therapies, and a weighted average of pemoline and no-treatment exhibitedextended dominance over methylphenidate. As before, the combination strategy became a viable(non-dominated) option for the analyses using school days only, the upper 95% confidence limitfor COMB or the worst-case scenario favouring non-pharmaceutical therapies; however, in eachof these cases it remained less cost-effective than methylphenidate.

Similar sensitivity analyses for the high dose pemoline strategy are presented in Table 14. Thefinding that pemoline at this dose is not dominated by methylphenidate but is less cost-effectivewas robust to all of the sensitivity analyses described with three exceptions. Pemoline becamedominant over other strategies when its effectiveness is taken at the upper 95% confidence limitfrom the meta-analysis. Pemoline also became more cost-effective than methylphenidate when thecompliance with methylphenidate therapy drops below 30%, while pemoline compliance remains100%, as shown in Figure 3. Conversely, it was dominated in the worst case scenario,presumably because of the very low 95% confidence limit resulting from the small sample size inthe meta-analysis.

Of note, results for the analysis including pemoline were also maintained when the risk of hepaticfailure was increased to a very high level of 1/1000.

4. Discussion4.1 InterpretationThis study used incremental cost-effectiveness analysis to evaluate alternative approaches to thetherapy of attention deficit hyperactivity disorder. Three global approaches were examined inrelation to non-treatment: pharmaceutical therapy, psychological/behavioural therapy, andcombination drug and psychological/behavioural therapy. Within the pharmaceutical therapygroup, three individual medications B methylphenidate, dextroamphetamine and pemoline B wereconsidered. Because pemoline is associated with rare but potentially fatal hepatic failure, and istherefore not considered a therapeutic option by many clinicians, the analysis was also performedafter excluding this strategy.

The results of the pemoline-exclusive analysis show that, relative to the no treatment comparator,

Page 143: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

one drug therapy B methylphenidate B dominates both dextroamphetamine and the non-pharmaceutical strategies. Methylphenidate costs $83 for each point difference in the ConnerTeacher Rating Scale, or approximately $498 for a clinically significant response.

The results were generally robust in sensitivity analysis, with the exception that substitution of the95% upper confidence boundary for efficacy of combination therapy caused that option to be non-dominated; however, it continued to have an inferior cost-effectiveness ratio compared tomethylphenidate. Similarly, when medications were given only on school days, combinationtherapy becomes viable, if less cost-effective, and dextroamphetamine is no longer strictlydominated; rather, a weighted average of no-treatment and methylphenidate exhibits >extendeddominance= over the DAS strategy.

When pemoline is included in the analysis at the lower dose used in the literature, the results aresimilar to those for the pemoline-exclusive analysis. Pemoline at the higher dose in the literaturebecomes a viable option, although it remains less cost-effective than methylphenidate, with a costof $106 per one-point improvement in Conner Teacher Rating Scale of $636 per clinicallysignificant improvement. These results are also robust in sensitivity analysis, with the exceptionof the dominance of pemoline at its upper 95% confidence limit or at extremes of compliance,both unlikely scenarios.

More importantly, pharmaceutical therapies were more attractive than psychological/ behavioraltherapies under all conditions, including the use of the upper confidence limit of efficacy frompublished studies. Thus, even if future studies were undertaken and the interval was narrowed tothe point of significance, it is unlikely that a Apackage@ of psychological/behavioral therapyconsisting largely of cognitive-behavior therapy for the child and training for the parents on howto implement the principles of cognitive-behavioral change, without adjunctive medical treatment,would become an economically attractive option.

Comparison of cost-effectiveness ratios across studies can be misleading because of differingmethodologies17 and outcome measures. Despite this caveat, the above values for cost-effectiveness of methylphenidate therapy do appear to compare favorably with those from otheraccepted health care interventions health interventions in the pediatric population. For example,the cost-effectiveness of inhaled corticosteroid treatment of childhood asthma was estimated at$9.45 per symptom-free day, corresponding to approximately $3449 per year of clinically-significant reduction in symptoms.18 Similarly, the pharmaceutical treatment of bulimia nervosahas been estimated to have a cost-effectiveness of $3117 for a one-year period of abstinence, andcombination pharmaceutical and cognitive-behavioral therapies in the same study yielded a cost-effectiveness of $4830 per year of clinical resolution.19

4.2 Study LimitationsPrior to applying the findings above to policy considerations, several limitations must berecognized. The most significant of these concerns the validity and stability of the estimates ofefficacy derived from the meta-analysis of published trials. The limitations of the literature on

Page 144: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

which efficacy inputs are based are detailed in Part 2 of the present series of reports and arebriefly reviewed here. With the exception of the methylphenidate alternative, the number ofacceptable trials (and thus the aggregate sample size) for each strategy was small, resulting inwide associated 95% confidence intervals. This problem was most marked for thepsychological/behavioral and the combination strategies, for which the estimates were based onfewer than 20 patients each, but even the pemoline strategy included only one acceptable study. It is possible that our rankings of cost-effectiveness are biased by the decreased power of thestudies to show an effect. Although sensitivity analysis on the extremes of the confidence boundsprovides some reassurance that psychological/behavioral therapy does not represent aneconomically sound option, this cannot be said about other options, which tended to becomeviable, although not preferred, as the confidence limits for efficacy from published trials werereached. Moreover, sensitivity analysis using meta-analytic credible intervals accounts only forsample size and not for study quality. Thus, if the smaller studies were not as methodologicallyrigorous as those found on the more popular topic of methylphenidate, it is possible that asystematic bias would be introduced.

The preference of pemoline over dextroamphetamine and non-pharmaceutical therapies (althoughnot over methylphenidate), and the dominance of pemoline in one sensitivity analysis, is ofpotential concern for a second reason. As noted earlier, the medication has significant non-behavioural health effects that are not captured in our measure of effect; specifically, life years lostfrom hepatic failure are not included in the analysis. Because no more inclusive health statusmeasure exists for this population, we have approached the problem by repeating the analysis afterexcluding pemoline from consideration. The rationale here is that, although the drug featuresprominently in the literature (and this in fact was the reason that it was included in the economicanalysis initially), the HPB approved product monograph states that because of its associationwith life-threatening hepatic failure, it should not ordinarily be considered as first-line therapy forADHD, and it appears that a majority of clinicians would no longer consider it as part of theirtherapeutic arsenal. In both cases, methylphenidate appears to be an appropriate first-line choiceon economic grounds.

A more general problem stems from the marked heterogeneity in treatments and in outcomemeasures across published trials. Although drug dosages and regimens are fairly comparable inthe literature, there is wide variability in the type and intensity of treatments studied aspsychological/behavioral alternatives. As noted in Part 2, the validity of pooling across suchheterogeneous therapies is questionable. Furthermore, it is possible that the types of checklistoutcome measures chosen, while providing a familiar and easily analyzable numeric outcome, maybe biased towards drug treatments by virtue of their reliance on symptoms such as hyperactivity. That these outcome measures may underestimate the usefulness of cognitive-behavioral therapy issupported to some extent by recent evidence that cognitive-behavioral procedures are moreeffective in enhancing academic performance but less effective in improving classroom behaviorthan certain other behavior modification therapies.20 Conversely, it is possible that medication maybe most efficacious at reducing the primary or Acore@ symptoms of ADHD, whilepsychological/behavioral therapies involving parents and/or teachers may be most efficacious atreducing associated features such as conflicted peers relations and academic underachievement

Page 145: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

which are secondary to social skill and academic skills deficits.21

A further limitation is the fact that the outcome for published efficacy trials is usually difference inbehavioral rating scales, rather than a dichotomous outcome indicating a clinically significantimprovement. The interpretation of the results of the cost-effectiveness analysis then becomesless intuitive, unless the results are bundled, as they were here, into a several-point difference. This process requires the assumption that many small improvements may be equivalent to a fewlarge improvements, an assumption that may not be tenable.In addition to these concerns regarding the efficacy data, some assumptions of our model itselfmay not hold. As discussed earlier, the one-year time horizon may bias the results againstcombination and psychological/behavioral therapies if they are extrapolated into the future, sincethe skills learned may be forgotten while the drugs retain their effect. Moreover, some of theefficacy data are derived from studies in which the follow-up period was in fact less than one year;the direction of any resulting bias in this case is unclear.

The model also assumed that efficacy is constant across baseline levels of ADHD severity. However, some literature suggests that state-contingent effects occur with stimulant drugs acrossa range of behavioral and other measures in children with ADHD. Accordingly, their responses tothese drugs vary inversely with their level of symptomatology in the drug-free state.22 Thisobviously would affect the generalizability of the findings, but again the direction of bias inrankings of cost-effectiveness is difficult to predict without data on whether the effects areconstant across treatment alternatives. The clinical trials examined in the meta-analysis, however,did not stratify according to symptom severity, and a definitive answer to the question is thereforenot available.

Finally, our study has necessarily synthesized data from several retrospective and secondarysources, including compliance, resource utilization and practice pattern information from anexpert panel. As this panel was a small sample of the population of clinicians treating ADHD, andby definition distinct in its familiarity with the disorder, its estimates may be not be representativeof Canadian physicians in general.

4.3 Future Research PossibilitiesFuture research should endeavor to correct the deficienciesin the data described. Specifically, the conduct of an economic analysis alongside randomizedtrials of treatment should be encouraged. This would provide prospective and bias-free estimatesof resource utilization and costs.In light of the profound impact of ADHD on a child=s educational achievement, and the highprevalence of the disorder, it is likely that the spillover effects of treatment on the educationalsystem would be at least as significant as those on the health sector, and potentially more so. Priority should be given to costing of these effects, and repetition of the above analysis withincorporation of those costs.

Finally, it is likely that the academic under-achievement, altered relations with peers and anxietyor emotional disorders associated with ADHD place a significant psychosocial burden on the childand family. This is not captured by an analysis that focuses exclusively on behavioral changes.

Page 146: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Assessment of health-related quality of life of the child and her family would add an importantdimension to both the clinical and economic literature on ADHD.

Page 147: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

References

1. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, 4th

Edition. Washington, DC. American Psychiatric Association, 1994.

2. Intercontinental Medical Statistics, Canada. Compuscript. Montreal, PQ, 1997.

3. Intercontinental Medical Statistics, Canada. Canadian Disease and Therapeutic Index.Montreal, PQ, 1997.

4. Efron D, Jarman F, Barker M. Side effects of methylphenidate and dextroamphetamine inchildren with attention deficit hyperactivity disorder: A double-blind, crossover trial.Pediatrics 1997; 100: 662-666.

5. Nehra A, Mullick F, Ishak KG, Zimmerman HJ. Pemoline-associated hepatic injury.Gastroenterology 1990;99:1517-1519.

6. Berkovitch M, Pope E, Phillips J, Koren J. Pemoline-associated fulminant hepatic failure:Testing for causation. Clin Pharmacol Ther 1995;57:696-698.

7. Morotta PJ, Roberts EA. Pemoline hepatotoxicity in children. J Pediatr 1998; 132:894-897

8. Shevell M, Schreiber R. Pemoline-associated hepatic failure: a critical analysis of theliterature. Pediatr Neurol 1997;16:14-16.

9. Abbott Laboratories. Pemoline, product monograph. In Canadian PharmaceuticalAssociation. Compendium of Pharmaceuticals and Specialties, Ottawa, Ontario, 1998.

10. Fischer M, Newby RF. Assessment of stimulant response in ADHD children using a refined multimodal clinical protocol. J Clinical Child Psychology 1991;20:232-244.

11. Firestone P. Factors associated with children=s adherence to stimulant medication. Amer JOrthopsychiat 1982;52:447-457.

12. Novartis Inc. Ritalin, product monograph. In Canadian Pharmaceutical Association.Compendium of Pharmaceuticals and Specialties, Ottawa, Ontario, 1998.

13. Greenhill LL. Attention-deficit hyperactivity disorder. The stimulants. Child AdolescPsychiatr Clinics N Am 1995;4:123-168.

14. Cunningham CE, Bremner R, Boyle M. Large group community-based parenting programsfor families of preschoolers at risk for disruptive behaviour disorders: utilization, costeffectiveness, and outcome. J Child Psychol Psychiat 1995;36:1141-1159.

Page 148: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

15. Krahn M, Detsky AS. Should Canada and the United States universally vaccinate infantsagainst Hepatitis B? A cost-effectiveness analysis. Med Decis Making 1993;13:4-20.

16 Margolis HS, Coleman PJ, Brown RE, Mast EE, Sheingold SH, Arevalo JA. Prevention ofHepatitis B virus transmission by immunization. An economic analysis of currentrecommendations. JAMA 1995;274:1201-1208.

17 Drummond M, Torrance G, Mason J. Cost-effectiveness league tables: more harm thangood? Soc Sci Med 1993;37:33-40.

18 Sullivan S, Elixhauser A, Buist AS, et al. National asthma education and prevention programworking group on the cost effectiveness of asthma. Am J Respir Crit Care Med.1996;154:S54-S95.

19 Koran LM, Agras WS, Rossiter EM, et al. Comparing the cost-effectiveness of psychiatrictreatments: bulimia nervosa. Psychiatry Reseacrh 1995;58:13-21.

20 DuPaul GJ, Eckert TL. The effects of school-based interventions for attention deficithyperactivity disorder: a meta-analysis. School Psychology Review 1997;26:5-27.

21 Dulcan M and the American Academy of Child and Adolescent Psychiatry Work Group onQuality Issues. Practice parameters for the assessment and treatment of children, adolescentsand adults with attention-deficit hyperactivity disorder. J Am Acad Child Adolesc Psychiatry1997; 36(Suppl): 85S-121S.

22 Gualtieri CT, Hicks RE, Mayo JP, Schroeder SR. The persistence of stimulant effects inchronically treated children: further evidence of an inverse relationship between drug effectsand placebo levels of response. Psychopharmacology 1984;83:44-47.

Page 149: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Table 1: Therapeutic Strategies for Children with Attention Deficit Disorder

Category of Therapy Specific Alternatives Considered________________________________________________________________________

Pharmaceutical Therapies MPH: MethylphenidateTreat with methylphenidate 10 mg/dose BIDevery day.

DAS: DextroamphetamineTreat with dextroamphetamine 15mg/day

given 10 mg in the morning and 5 mg at lunch, every day.

PEM: pemolineTreat with pemoline 37.5 or 75 mg/day once daily, every day.

Psychological/Behavioral Therapies PSYCH/BEHAV: Non-Medical Package

Provide 16 hours of individual cognitive–behavioral (CBT) therapy to child by psychologistin private practice, 8 hours of parent training(application of CBT principles; some training inchild behavior modification), and 2 hours teachertraining.

Combination Therapies COMB: Combination TherapyProvide methylphenidate as for MPH and psychological/behavioral therapy as forPSYCH/BEHAV.

No Treatment Comparator NORX:Provide four additional visits to general

practitioner but no other interventions.

________________________________________________________________________

Page 150: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Table 2: Unit Costs of Pharmaceuticals

Drug Unit Cost Per Unit ($)_________________________________________________________________________

Methylphenidate (Generic) 10 mg tablet 0.29

Ritalin (Methylphenidate proprietary) 10 mg tablet 0.37

Dexedrine (Dextroamphetamine proprietary) 5 mg tablet 0.36

Dexedrine (Dextroamphetamine proprietary) 10 mg tablet 0.56

Cylert (pemoline proprietary) 37.5 mg tablet 0.87

Cylert (pemoline proprietary) 75 mg tablet 1.53

Abstracted from data supplied by IMS Canada (Compuscript file, 1996). Costs are based onnational averages and include dispensing fees and markups.

Page 151: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Table 3: Psychological/behavioral Costs

Item Cost Range forSensitivity Analysis

($) ($)________________________________________________________________________

Complete Blood Count 13.50

Liver Function Tests (AST, ALT) 11.70

Toxic Hepatitis 1860 508, 38064

Pediatrician 67 per visit 54,80

General Practitioner 32 per visit 26,38

Psychiatrist 72 per visit 58,86

Psychologist 72 per hour 58,86

Parent training 78 per hour 62,94

Teacher training 85 per hour 68,102

_______________________________________________________________________

Page 152: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Table 4: Efficacy of Alternative Therapeutic Strategies:Difference in Conner Teachers’ Rating Scale

Alternative Weighted Mean Difference * Number of AggregateMean 95% C.I. Trials

Sample Analyzed Size

__________________________________________________________________

MPH 6.70 5.89, 7.58 8 421

DAS 4.71 2.99, 6.43 4 61

PEM (2.8 mg/kg dose) 7.80 4.36, 11.24 1 28

PEM (1.4 mg/kg dose) 4.00 0.20, 7.80 1 28

PSYCH/BEHAV 0.30 -5.07, 4.47 1 13

COMB 3.78 0.51, 8.06 2 19

* Expressed as reduction in Conners Teacher Rating Scale in intervention arm

Page 153: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Table 5: Yearly Costs for Alternative Therapeutic Strategies (Base Estimates)

Alternative Item Cost ($) Subtotal ($) Total ($)________________________________________________________________________MPH 10mg tablet BID X 365 days 270.10

Medical Visits2 specialist 139.004 GP 128.00

CBC (baseline and q12mo) 27.00 564.10

DAS 1 X 10mg tablet OD and 204.401 X 5mg tablet OD X 365 days 131.40Medical Visits

2 specialist 139.003 GP 96.00 570.80

PEM (1.4 mg/kg) 37.5 mg tablet OD X 365 days 317.55Medical Visits

2 specialist 139.002 GP 64.00

AST, ALT (baseline and q 6 mo) 35.10 555.65

PEM (2.8 mg/kg) 75 mg tablet OD X 365 days 558.45Medical Visits

2 specialist 139.002 GP 64.00

AST, ALT (baseline and q 6 mo) 35.10 796.55

PSYCH/BEHAV Child counseling X 16hr 1152.00Parent training X 8hr 624.00Teacher training X 2hr 170.00 1946.00

COMB 10mg tablet BIDX 365 days 270.10

Medical Visits2 specialist 139.004 GP 128.00

CBC (baseline and q12mo) 27.00Child counseling X 16hr 1152.00Parent training X 8hr 624.00Teacher training X 2hr 170.00 2510.10

Page 154: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Table 6: Expected Costs and Effects of Alternative Strategies Using Base Case Estimates (Pemoline Excluded)

Strategy Cost Incremental Effectiveness Incremental Cost-EffectivenessCost Effectiveness

(C ) (∆C) (E) (∆E) C/E ∆C/∆E($) ($) (CTRS points) (CTRS points) ($ per CTRS point)

Do Nothing 128 0

MPH 559 431 6.7 6.7 83 64

DAS 566 7 4.7 -2.0 120 DOM

PSYCH/BEHAV 1946 1380 0.3 -4.4 6487 DOM

COMB 2505 559 3.8 3.5 663 DOM________________________________________________________________________

Page 155: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Table 7: Cost-Effectiveness of Alternative Strategies Using Base Case Estimates Following Elimination of Dominated Strategies (Pemoline Excluded)

Strategy Cost Incremental Effectiveness Incremental Cost-EffectivenessCost Effectiveness

(C ) (∆C) (E) (∆E) C/E ∆C/∆E($) ($) (CTRS points) (CTRS points) ($ per CTRS point)

Do Nothing 128 0Methylphenidate 559 431 6.7 6.7 83 64

Page 156: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Table 8: Sensitivity Analyses (Pemoline Excluded)

Variable Analyzed Cost-Effectiveness (C/E) with reference to Non-treatment Comparator ($)MPH DAS PSYCH/BEHAV COMB

Base Case 83 D D D

Generic MPH 75 D D D

School Days Only 119 ED D 630

120% clinician fee 91 D D D80% clinician fee 76 D D D

Fewer CounselingHours but SameEffect 83 D D D

ConfidenceLimits:

MPH low 95 D D DMPH high 74 D D D

DAS low 83 D D DDAS high 83 D D D

NON low 83 D D DNON high 83 D D D

COMB low 83 D D DCOMB high 83 D D 311

Worst Case Scenario 103 D D 196(Favor PSYCH/BEHAV)

Weight 16kg 66 ED D D40 kg 101 D D D

LegendD: Dominated (Strict)ED: Dominated (Extended, in weighted average with no-treatment comparator)

Page 157: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Table 9: Expected Costs and Effects of Alternative Strategies Using Base Case Estimates (Pemoline 1.4 mg/kg Included)

Strategy Cost Incremental Effectiveness Incremental Cost-EffectivenessCost Effectiveness

(C ) (∆C) (E) (∆E) C/E ∆C/∆E($) ($) (CTRS points) (CTRS points) ($ per CTRS point)

Do Nothing 128 0

MPH 559 431 6.7 6.7 83 64

DAS 566 7 4.7 -2.0 120 DOM

PEM 588 23 4.0 -0.7 147 DOM

PSYCH/BEHAV 1946 1358 0.3 -3.7 6487 DOM

COMB 2505 559 3.8 3.5 663 DOM________________________________________________________________________

Page 158: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Table 10: Cost-Effectiveness of Alternative Strategies Using Base Case Estimates Following Elimination of Dominated Strategies (Pemoline 1.4 mg/kg Included)

Strategy Cost Incremental Effectiveness Incremental Cost-EffectivenessCost Effectiveness

(C ) (∆C) (E) (∆E) C/E ∆C/∆E($) ($) (CTRS points) (CTRS points) ($ per CTRS point)

Do Nothing 128 0

Methylphenidate 559 431 6.7 6.7 83 64

________________________________________________________________________

Page 159: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Table 11: Sensitivity Analyses (Pemoline 1.4 mg/kg Included)

Variable Analyzed Cost-Effectiveness (C/E) with reference to Non-treatment Comparator ($)MPH DAS PEM PSYCH/BEHAV COMB

Base Case 83 D D D D

Generic MPH 75 D D D D

School Days Only 119 ED D D 630

120% clinician fee 91 D D D D80% clinician fee 76 D D D D

Fewer CounselingHours but SameEffect 83 D D D D

ConfidenceLimits:

MPH low 95 D D D DMPH high 74 D D D D

DAS low 83 D D D DDAS high 83 D D D D

PEM low 83 D D D DPEM high ED D 75 D D

NON low 83 D D D DNON high 83 D D D D

COMB low 83 D D D DCOMB high 83 D D D 311

Worst Case Scenario 103 D D D 196(Favor PSYCH/BEHAV)

Weight 16 kg 66 ED D D D40 kg 71 D D D D

LegendD: Dominated (Strict)ED: Dominated (Extended, in weighted average with no-treatment comparator)

Page 160: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Table 12: Expected Costs and Effects of Alternative Strategies Using Base Case Estimates (Pemoline 2.8 mg/kg Included)

Strategy Cost Incremental Effectiveness Incremental Cost-EffectivenessCost Effectiveness

(C ) (∆C) (E) (∆E) C/E ∆C/∆E($) ($) (CTRS points) (CTRS points) ($ per CTRS point)

Do Nothing 128 0

MPH 559 431 6.7 6.7 83 64

DAS 566 7 4.7 -2.0 120 DOM

PEM 829 263 7.8 3.1 106 85

PSYCH/BEHAV 1946 1117 0.3 -7.5 6487 DOM

COMB 2505 559 3.8 3.5 663 DOM__________________________________________________________________

Page 161: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Table 13: Cost-Effectiveness of Alternative Strategies Using Base Case Estimates Following Elimination of Dominated Strategies (Pemoline 2.8 mg/kg Included)

Strategy Cost Marginal Effectiveness Marginal Cost-EffectivenessCost Effectiveness

(C ) (∆C) (E) (∆E) C/E ∆C/∆E($) ($) (CTRS points) (CTRS points) ($ per CTRS point)

Do Nothing 128 0

Methylphenidate 559 431 6.7 6.7 83 64

Pemoline 829 270 7.8 1.1 106 246

Page 162: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Table 14: Sensitivity Analyses (Pemoline 2.8 mg/kg Included)

Variable Analyzed Cost-Effectiveness (C/E) with reference to Non-treatment Comparator ($)MPH DAS PEM PSYCH/BEHAV COMB

Base Case 83 D 106 D D

Generic MPH 75 D 106 D D

School Days Only 119 ED 135 D D

120% clinician fee 91 D 111 D D80% clinician fee 76 D 101 D D

Fewer CounselingHours but SameEffect 83 D 106 D D

ConfidenceLimits:

MPH low 95 D 106 D DMPH high 74 D 106 D D

DAS low 83 D 106 D DDAS high 83 D 106 D D

PEM low 83 D D D DPEM high ED D 74 D D

NON low 83 D 106 D DNON high 83 D 106 D D

COMB low 83 D 106 D DCOMB high 83 D 106 D 311

Worst Case Scenario 103 D D D 196(Favor PSYCH/BEHAV)

Weight 16 kg 66 ED 76 D D40 kg 71 D 96 D D

LegendD: Dominated (Strict)ED: Dominated (Extended, in weighted average with no-treatment comparator)

Page 163: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

List of Figures

Figure 1. Decision analysis tree diagram (pemoline included)Figure 2. Decision analysis tree diagram (pemoline excluded)Figure 3. Sensitivity analysis: Effect of compliance rate with MPH on cost-effectiveness of

pharmaceutical strategies (pemoline excluded).Figure 4. Sensitivity analysis: Effect of compliance rate with MPH on cost-effectiveness of

pharmaceutical strategies (pemoline included 1.4 mg/kg).Figure 5. Sensitivity analysis: Effect of compliance rate with MPH on cost-effectiveness of

pharmaceutical strategies (pemoline included 2.8 mg/kg).Figure 6. Incremental Cost and Effectiveness of Therapies for ADHD, pemoline ExcludedFigure 7. Incremental Cost and Effectiveness of Therapies for ADHD, Including pemoline at

Low DoseFigure 8. Incremental Cost and Effectiveness of Therapies for ADHD, Including pemoline at

High Dose

Page 164: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Review of Therapies - Part 3

Appendix Advisory and Expert Panels

A six-person panel provided information on the provision and costs of psychological/ behaviouraltherapy in their communities. Two members, a Montreal paediatrician with special interest indevelopmental-behavioural paediatrics and the B.C psychologist active in a community-basedclinic for children and youth with learning and behavioural problems, also served on a larger, 11-person panel whose composition and function are described below. Other members of the six-person panel were: a child psychiatrist from Montreal, a family and behavioural consultant whoruns a community-based clinic for children and youth with learning and behavioural problems inSaskatoon, the director of a community-based organisation providing services to children andfamilies with a variety of behavioural and social difficulties in lower mainland area of B.C., and anadministrator of a program for ADHD intervention run by the Greater Vancouver Mental HealthService in B.C. Each of these panelists provided information about the provision, availability andcosts of psychological/behavioral therapies in their respective communities. Average dollar valuesfor various forms of therapies provided in different settings were calculated from the individualestimates provided.

The larger 11-person panel consisted of four academically-based child and family psychiatrists,three general paediatricians (one with special interest and training in developmental-behaviouralpaediatrics), two subspecialist developmental-behavioural paediatricians, a family practitioner withan interest in ADHD and a clinical psychologist active in assessment and management of ADHDin the community, and supplied information on their experience and management of ADHD inchildren. In particular, they documented their expectations of: (1) spontaneous resolution ofADHD symptoms over time; (2) uptake of treatment recommendations by patients; and (3) ratesof dropping out from various forms of treatment. Six of the eleven reside in B.C., one inSaskatchewan, two in Ontario, one in Quebec and one in the U.S.

A seven-person subgroup of this main panel provided information about their perceptions of thelikelihood of a child/family receiving various forms of therapy and the amount of therapy theywere likely to receive. This subgroup consisted of two child and family psychiatrists, two generalpaediatricians, a developmental-behavioural paediatrician and the family practitioner andpsychologist.

Page 165: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Figure 1: Decision Analysis Tree Diagram (Pemoline included)

No Treatment

Toxicity

Non-Compliance

ComplianceNo Toxicity

Methylphenidate (MPH)

Toxicity

Non-Compliance

ComplianceNo Toxicity

Dextroamphetamine (DEX)

Toxicity

Non-Compliance

ComplianceNo Toxicity

Pemoline (PEM)

Non-Compliance

ComplianceNon-Drug Therapy (NON-DRUG)

Toxicity

Non-Compliance

ComplianceNo Toxicity

Combined Therapy (COMB)

Diagnosed ADD

Page 166: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Figure 2: Decision Analysis Tree Diagram (Pemoline exluded)

No Treatment

Toxicity

Non-Compliance

ComplianceNo Toxicity

Methylphenidate (MPH)

Toxicity

Non-Compliance

ComplianceNo Toxicity

Dextroamphetamine (DEX)

Non-Compliance

ComplianceNon-Drug Therapy (NON-DRUG)

Toxicity

Non-Compliance

ComplianceNo Toxicity

Combined Therapy (COMB)

Diagnosed ADD

Page 167: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

0

20

40

60

80

100

120

140

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1

Compliance Rate

Exp

ecte

d C

ost /

Eff

ect

MPHDEX

Figure 3: Sensitivity Analysis: Effect of Compliance Rate with Methylphenidate Therapy on Cost-Effectiveness of Pharmaceutical Strategies,

Pemoline Excluded

Page 168: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

0

20

40

60

80

100

120

140

160

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1

Compliance Rate

Exp

ecte

d C

ost /

Eff

ect

MPHDEXPEM

Figure 4: Sensitivity Analysis: Effect of Compliance Rate with Methylphenidate Therapy on Cost-Effectiveness of Pharmaceutical Strategies,

Including Pemoline at Low Dose

Page 169: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

0

20

40

60

80

100

120

140

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1

Compliance Rate

Exp

ecte

d C

ost /

Eff

ect

MPHDEXPEM

Figure 5: Sensitivity Analysis: Effect of Compliance Rate with Methylphenidate Therapy on Cost-Effectiveness of Pharmaceutical Strategies,

Including Pemoline at High Dose

Page 170: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Figure 6: Cost-Effectiveness of Therapies for ADHDExcluding Pemoline

Cost

Effe

ctiv

enes

s

$100 $700 $1300 $1900 $2500

7.2

6.4

5.6

4.8

4.0

3.2

2.4

1.6

0.8

0.0

Do-Nothing

Methylphenidate

Dextroamphetamine

Non-Drug Therapy

Combined Therapy

Page 171: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Figure 7: Cost-Effectiveness of Therapies for ADHD

With Pemoline Included at Low Dose

Cost

Effectiveness

$100 $700 $1300 $1900 $2500

7.2

6.4

5.6

4.8

4.0

3.2

2.4

1.6

0.8

0.0

Do-Nothing

Methylphenidate

Dextroamphetamine

Pemoline

Non-Drug Therapy

Combined Therapy

Page 172: A REVIEW OF THERAPIES FOR ATTENTION- … · 6 Review of Therapies - Part 1 undemonstrated.12,13 An argument advanced to explain the discrepancy between short-term efficacy studies

Figure 8: Cost-Effectiveness of ADHD TherapiesWith Pemoline Included at High Dose

Cost

Effe

ctiv

enes

s

$100 $700 $1300 $1900 $2500

8.0

7.0

6.0

5.0

4.0

3.0

2.0

1.0

0.0

Do-Nothing

Methylphenidate

Dextroamphetamine

Pemoline

Non-Drug Therapy

Combined Therapy