ALLISON METZ, Ph.D. National Implementation Research ... Metz... · Allison Metz, Ph.D., is a developmental psychologist, Director of the National Implementation Research Network,

ALLISON METZ, Ph.D. National Implementation Research Network

Frank Porter Graham Child Development Institute University of North Carolina at Chapel Hill

EDUCATION Catholic University of America, Washington, DC

Ph.D. 2001, Human Development, Psychology, with Honors and Distinction M.A. 1998, Human Development, Psychology

Boston University, Boston, MA B.A. 1994, Psychology with Honors

Washington School of Psychiatry, Washington, DC Post-Doctoral Training, 2007-2008, Completion of one-year training program in psychodynamic psychotherapy

AREAS OF EXPERTISE

Expertise in the areas of implementation science, program replication, organizational and systems change, scale-up, program fidelity, research design, mixed methods methodology, training and technical assistance projects, implementation support, coaching, and capacity building

Content area knowledge and expertise in child welfare, early childcare and education, early childhood, and adolescence

Product and tool development to support implementation, replication and scale-up of innovations and evidence-based strategies in human service and education settings

Current Positions

National Implementation Research Network, Frank Porter Graham Child Development Institute,

University of North Carolina at Chapel Hill

Director and Senior Scientist, April 2009 – present

Allison Metz, Ph.D., is a developmental psychologist, Director of the National Implementation Research Network, and Senior Scientist at the Frank Porter Graham Child Development Institute, University of North Carolina at Chapel Hill. Dr. Metz is currently working on several projects supporting the effective implementation, replication, and scaling-up of evidence-based, evidence-informed, and innovative programs in child welfare and early childhood. Dr. Metz divides her time between several projects including:

National Center on Early Childhood Development, Teaching and Learning. Principal Investigator. Funded through Zero to Three by the Administration for Children and Families at the U.S. Department of Health and Human Services, this $70 million, 5-year Center will develop the capacity of early childhood practitioners to use evidence-based practices to improve outcomes for children in early care settings including child care, Head Start, and Early Head Start.

Partnership in Using Implementation Science to Improve Implementation of Evidence-Based Home Visiting in Montana. Principal Investigator. Funded by Montana Department of Public Health and Human Services. The goals of this three year partnership will be reached through the following inter-related tasks: 1) develop State Implementation Team; 2) build capacity of

ALLISON METZ (continued)

State Implementation Team on the principles and frameworks of implementation science through onsite and online guided learning sessions; 3) assess the current implementation infrastructure to support EBHV models in Montana; 4) identify roles and functions of key stakeholders needed to co-create the implementation infrastructure for EBHV in Montana; and 5) initiate model-specific learning communities to build implementation competencies of local sites implementing EBHV models.

Family Success Centers. Principal Investigator. Funded by the New Jersey Department of

Children and Families through Rutgers University, this project seeks to create the conditions to

strengthen families and empower individuals to acquire the knowledge necessary to have

successful families as well as raise healthy and happy children through Family Success Centers.

The National Implementation Research Network supports quality implementation of Family

Success Centers (FSCs) through an Active Implementation approach that involves four major

goals: 1) define and operationalize the roles, functions, and core activities of the FSC

practitioners; 2) assist the FSCs in refining their way of work as they engage with families

through usability testing processes; 3) assess and identify the infrastructure and supports

needed to ensure high quality implementation of defined FSC functions; and 4) build the initial

capacity of DCF, Rutgers University and FSC staff to effectively use Active Implementation

Frameworks as they assist FSCs in consistent and effective implementation of practices.

Evidence-Based Practice Implementation Blueprint. Principal Investigator. Funded by Annie E.

Casey Foundation, in partnership with New Jersey Department of Children and Families, this

project will develop a blueprint for how public child welfare agencies and private service

provider partners can successfully integration of evidence-based practices into the service array.

The blueprint will define the continuum of evidence (evidence-based (EB), evidence informed

(EI), promising practice (PP), practice based evidence (PB), etc.) and include guidelines for

selection of EB/EI programs, developing an enabling context, implementation, and evaluation

and quality improvement practices.

Healthy Places North Carolina. Principal Investigator. Funded by the Kate B. Reynolds Charitable

Trust, this 10 year project seeks to create the conditions for initial, sustainable, and dramatic

improvements in the health of all the people who live in selected Tier 1 counties in North

Carolina. Dr. Metz is supporting this work through a capacity-building approach that involves 1)

operationalizing and continuously refining the roles, functions, and core activities of the HPNC

Program Officer through program development, rapid cycle problem solving and usability

testing; 2) coaching HPNC Program Officers as they refine their way of work engaging with

counties; and 3) conducting a ground level evaluation of the early phases of the HPNC project by

capturing work to date in a systematic manner.

Past Projects at National Implementation Research Network

Thrive By Five Partnership Grant. Co-Principal Investigator. Funded by Thrive By Five, this partnership grant aims to build the capacity of the Thrive By Five Hub to support effective implementation of home visiting models statewide in Washington. Specifically, NIRN seeks to


1) build general competencies to promote effective implementation including strategic thinking, group process, joint problem solving, and reflective practice; and 2) build core implementation competencies that Thrive Implementation HUB staff members need to apply in order to achieve high-fidelity, sustainable implementation of evidence-based home visiting models and innovations.

Partnership in Using Implementation Science to Improve Outcomes for Children and Families. Principal Investigator. Funded by Casey Family Programs, The National Implementation Research Network (NIRN) partners with Casey Family Programs (CFP) to integrate principles and frameworks of implementation science into their ongoing technical assistance and strategic support of jurisdictions to achieve better outcomes for children and families.

Ohio Alternative Response Project. Principal Investigator. Through a subcontract with the American Humane Association, technical assistance is provided on the scaling up of the State of Ohio’s Differential Response Model in Child Welfare. Year 1 activities include trainings with the Leadership Council for the Differential Response model and State Policy Leaders. In Year 2, it is expected NIRN will work to build the capacity of AHA and State Leadership to increase staff competencies to implement high quality AR services and improve the implementation and sustainability of the Alternative Response Model in current pilot counties. Specific activities include 1) assess current implementation structures, practices and strategies for facilitating high-quality implementation of AR and promoting state-wide scale-up; 2) develop a formal multi-level infrastructure within the state to support and sustain implementation of AR; 3) seed state and local implementation capacity by training state and county implementation teams on evidence-based implementation strategies; and 4) conduct on-site coaching and modeling of best practices for effective implementation with selected new counties.

Permanency Innovations Initiative Training and Technical Assistance Project (PII-TTAP). Principal Investigator. Funded by the Children’s Bureau, in the Administration for Children and Families, this 5-year initiative aims to improve the outcomes for subgroups of children in foster care that have the most serious barriers to permanency. The PII-TTAP team will provide integrated and coordinated T/TA to the PII grantees in the implementation of their innovative intervention strategies. While the grantees provide T/TA at the practice and frontline levels, the focus of this project is to provide T/TA at the organization and systems levels addressing strategic planning, infrastructure development, effective collaboration, organizational and systems development, change management, leadership, and implementation science.

Evaluation of Georgia’s Child Care Resource and Referral Network. Study Lead. Funded by Georgia’s Department of Early Care and Learning. This grant supports the evaluation of the Georgia’s current R&R system and the development of recommendations for a system “to be.” These recommendations will focus on strategies to improve child care quality, strategies to improve the implementation infrastructure, and strategies to improve continuous improvement processes.

The Catawba County Child Wellbeing Project. Principal Investigator. Funded by the Duke Endowment, this 15-year initiative will involve the implementation of a range of evidence-based and innovative programs in the child welfare system in Catawba County, North Carolina.


A random assignment evaluation design will assess the impact of post-permanency services on the well-being of children who exit the foster care system to a permanent placement such as reunification, adoption, or kinship care. Dr. Metz provides intensive technical assistance to the county to support the effective replication of selected evidence-based practices, develop innovative, evidence-informed intervention models, build agency capacity, increase staff competencies to implement high-quality, high-fidelity interventions, and promote wide-spread systems change in child welfare.

Child Trends, Washington, DC

Senior Research Scientist, January 2007 to April 2009

As a Senior Research Scientist, Dr. Metz is a Co-Principal Investigator and Senior Scientist for research and technical assistance projects across several content areas including early childhood, child welfare, youth development, parenting and family dynamics, and fertility and family structure. She conducts research on and provides implementation-related technical assistance to out-of-school time, early childhood, child welfare, fatherhood, and youth development programs. Currently, Dr. Metz is focused on the identification and replication of evidence-based practices. Dr. Metz divides her time between several projects including:

Duke Endowment Catawba County Project. Co-Principal Investigator. Funded by the Duke Endowment, this 15-year initiative will involve the implementation of a range of evidence-based and innovative programs in the child welfare system in Catawba County, North Carolina. A random assignment evaluation design will assess the impact of post-permanency services on the well-being of children who exit the foster care system to a permanent placement such as reunification, adoption, or kinship care. Dr. Metz provides intensive technical assistance to the county to support the effective replication of selected evidence-based practices, develop innovative, evidence-informed intervention models, build agency capacity, and promote wide-spread systems change in child welfare.

Comprehensive Evaluation of the Minnesota Early Childhood and School-Age Care Professional Development System. Senior Scientist and Task Leader. Funded by the Minnesota Department of Human Services, this study will be a comprehensive evaluation of the five major components of the professional development system for early childhood and school-age care providers in Minnesota. The evaluation will generate findings related to improved outcomes in professional development and quality improvement for early childhood and school-age programs for young children in Minnesota. Dr. Metz will also provide implementation-related technical assistance to the State to help identify key target populations and stakeholder groups, link and align logic models with strategic plans, assess baseline levels of buy-in among target communities, and identify technical and adaptive challenges.

Family Planning Service Delivery Improvement Grant. Senior Scientist and Task Leader. Funded by the Office of Population Affairs, this three-year study aims to help reduce high rates of teenage and unintended pregnancy among Hispanics in the U.S. by employing quantitative, qualitative and applied research methods to better assess who is and is not accessing family planning services and why. This project will help improve service delivery by providing national data analyses and in-depth perspectives from teens and young adults, as well as providers, on how to best encourage or support Hispanic immigrant and non-immigrant women in utilizing family planning services. The project will result in the identification of strategies that are feasible to implement and can be used to attract Hispanic women in need of family planning


services to clinics and programs. A key aim of the project will be to translate the research findings to make them accessible to the practitioner community. Dr. Metz will work with a clinic or provider in each of the target cities to assess the capacity of these programs to use the findings generated by this study, improve translation of the findings, and construct implementation guidelines for the broader family planning practitioner community. The goal of this stage will be to bridge the research-to-practice gap and develop usable products to support the implementation of research findings.

Evaluation of the Head Start Innovation and Improvement Project/Online Associates Degree for Infant and Toddler Teachers. Project Director and Co-Principal Investigator. This 3-year project funded by the Office of Head Start involves the development and delivery of an online associate’s degree for both English and Spanish-speaking Early Head Start professionals and other early childcare providers serving children ages zero to three years. An implementation and pre-post outcome study of the online associate’s degree program will be conducted. System-level changes including the availability and access to degree programs for Early Head Start professionals and the capacity of higher education to support online learners will be assessed. Teacher-level changes such as changes in the participation in degree programs, knowledge, skills and competencies among Early Head Start professionals will also be examined. Dr. Metz serves as the overall project director and will lead the implementation evaluation.

Research to Results Initiative. Senior Scientist. Funded by The Atlantic Philanthropies, this project is addressing the need for a coordinated effort to integrate, and disseminate information to a diverse group of direct-service providers, researchers, media professionals, policy makers, and others to produce important lessons about best policies and practices for youth development. In so doing, the proposed project will improve programs and policies and ultimately outcomes for children and youth. Project activities center on integrating and disseminating information developed for and with participants of three roundtables: (1) Media Roundtables; (2) Practitioner Roundtables; and (3) Youth Roundtables.

Wendy’s Wonderful Kids. Senior Scientist. This nationwide five year random assignment study funded by the Dave Thomas Foundation for adoption will assess the impact of child-focused recruitment efforts for attainting permanent adoptive homes for older youth in foster care compared to more traditional recruitment efforts. Dr. Metz will lead the development of fidelity measures and the implementation of a fidelity assessment.

Youthline. Co-Principal Investigator. This four year youth development project funded by the Kellogg Foundation is a multi-component initiative which promotes partnerships and activities that connect young people to their communities. Youthline plans to implement several activities that allow youth to take an active role in collecting and analyzing data on youth-related resources in their communities and utilizing this information to benefit themselves, their peers, and their communities.

Planning and Learning Technologies, Inc., Division on Special Projects for Children and Families -

Arlington, VA

Senior Research Associate, 2004 to 2006

As a Senior Research Associate, Dr. Metz responded to requests for proposals and capability statements to evaluate child welfare, Head Start, and related programs, to provide technical


assistance in the implementation and evaluation of pilot demonstration programs and special initiatives, and to identify best practices and develop strategies for the widespread dissemination of innovative practices within the early childhood and child welfare fields. Dr. Metz managed several projects within the Division of Special Projects for Children and Families:

Assessment of Head Start Innovation and Improvement Projects, National Head Start Training and Technical Assistance Resource Center. Project Director. Dr. Metz assessed the progress of Head Start Innovation and Improvement Projects during a three-year implementation period, synthesized process and outcome findings, and identified replicable, innovative strategies for improving services to Head Start families and increasing the capacity of Head Start grantees to effectively manage their programs. She was responsible for collecting standardized data from projects on a quarterly basis via conference call and on-site visits. Dr. Metz was also responsible for providing grantees with technical assistance to strengthen their interventions, improve the replicability of their program models, and to enhance their evaluation component to determine their intervention’s effectiveness. Dr. Metz served on a small work group charged with developing strategies to ensure that usable and effective products were developed which could benefit the broader Head Start community. Dr. Metz wrote site visit reports and synthesized activities and progress across the grants. Dr. Metz authored the final report on planning phase activities describing grantees’ progress in the planning phase and anticipated success in implementation.

The National Evaluation of the Court Improvement Program. Site Leader. This five year Federal study was funded to describe dependency/neglect court reform evaluations across the country and included in-depth outcome studies of a small number of model reforms. Dr. Metz served as a Site Leader for this project and was responsible for overseeing the process and outcome studies at that site, including collecting and analyzing administrative data, conducting interviews and focus groups with key stakeholders, analyzing case records, and conducting family court observations.

The Quality Improvement Center on Child Welfare Privatization. Evaluation Co-Director. This is a five year project funded by the Children’s Bureau to review current practices and research in child welfare privatization, select and support demonstration programs, and build knowledge on child welfare privatization to improve outcomes for children and families. As a Task Leader for this five year Federal Initiative, Dr. Metz managed the provision of evaluation-related technical assistance to grantees funded through the Quality Improvement Center, as well as managed the cross-site evaluation of these grantees. Dr. Metz was also responsible for tasks associated with the national needs assessment on child welfare privatization including the analysis and synthesis of qualitative data collected through regional forums with key stakeholders.

James Bell Associates- Arlington, VA

Senior Research Associate, 2001 to July 2004

Dr. Metz managed evaluation projects within the company’s child welfare practice and provided technical assistance to grantees on evaluation design, data collection, analysis, and reporting.

Projects included the following:

Evaluation of Quality Improvement Centers. Project Manager. Dr. Metz oversaw the day-to-day activities of the implementation of the cross-site evaluation and served as the primary contact person for the individual sites and the Children’s Bureau. Dr. Metz was


responsible for writing monthly progress reports on the status of the evaluation. She was involved in the review of documents and creation of program and evaluation profiles for each quality improvement center. She developed interview protocols, participated in site visits and conducted interviews and focus groups. Dr. Metz collected and analyzed program implementation and evaluation data individually and cross-site.

Technical Assistance on Program Evaluation to Adoption Opportunities and Child Abuse and Neglect Grantees. Senior Research Associate. Dr. Metz provided grantees with a wide range of evaluation-related technical assistance, including the review of evaluation plans, the construction of program logic models, site visits, and the review of data collection instruments and data analysis plans. Technical assistance also involved the dissemination of relevant evaluation materials to grantees, as well as referrals to other grantees conducting similar projects. Dr. Metz served as the primary contact person for the Replication of Demonstrated Effective Prevention Program grantees and was responsible for the development and implementation of a cross-site framework and fidelity assessment criteria within this priority area.

Program Evaluation of the Community Substance Abuse Prevention and Treatment Program. Senior Research Associate. Dr. Metz served as a co-evaluator of a multi-year evaluation of programs for families whose substance abuse is a barrier to maintaining, preserving, or reunifying the family, or maintaining self-sufficiency in the workplace. The evaluation involved process and outcome studies for the State of Arizona. Dr. Metz was involved with planning and writing the evaluation plan, as well as identifying appropriate data elements and measurements for the process and outcome evaluations. Dr. Metz participated in evaluation-related activities, such as site visits to conduct interviews and focus groups with program directors, case workers, and clients, steering committee meetings to disseminate information, and writing semi-annual and annual reports.

Office of Justice Programs, Drug Court Clearinghouse and Technical Assistance Project- Washington,

DC

Project Coordinator, 2000 to 2001

Dr. Metz managed a cross-site national database on federal drug court grantees and produced impact analyses on drug court operations nationwide for the Drug Courts Clearinghouse and Technical Assistance Project. Dr. Metz also co-wrote quarterly reports.

The Life Cycle Institute, Catholic University of America- Washington, DC

Research Assistant, 1995 to 2001

Dr. Metz conducted survey and observational research related to adolescent development, including the longitudinal effects of school-based community service and longitudinal changes in adolescents’ relationships and crowd affiliations throughout high school. Selected examples of these studies include the following:

Healthy Adolescents in the 21st Century. Co-Investigator. This one-year, funded study assessed national adolescent trend data on a variety of indicators, including teenage pregnancy, juvenile crime, and education achievement scores. Dr. Metz researched and analyzed data, developed indicators of adolescent behaviors and attitudes, and wrote a final report synthesizing trend data over a 40-year period.


Adolescent Development and Community Service. Co-Investigator. Dr. Metz co-managed a four-year funded study which examined the longitudinal effects of community service on adolescent development, as well as the impact of different school-based community service programs on volunteers. Dr. Metz created surveys to collect self-report data from adolescents. Dr. Metz created observational and interview protocols to examine different school programs. Dr. Metz conducted interviews and focus groups with teachers and students and observations of youth participating in the community service program.

Vanderbilt University Institute for Public Policy Studies, Center for Mental Health Policy- Washington, DC Research Associate, 1998 to 2000

Evaluation of Supported Housing for the Seriously Mentally Ill. Project Evaluator. Dr. Metz coordinated a five year, multi-site study on the impact of supported housing on the mentally ill. Dr. Metz conducted site visits to assess the impact of system and project level data. She provided technical assistance to individual grantees, including the development of site-specific logic models and the assessment of barriers to program implementation. Dr. Metz conducted interviews and focus groups with program managers, frontline caseworkers, and mental health consumers. She participated in the development of a protocol for assessing the fidelity of the programs’ housing models to the required model of supported housing. Dr. Metz also developed and implemented a scheme for assessing inter-rater reliability in a multi-site study, managed the cross-site database and performed cross-site statistical analyses.

General Accounting Office- Washington, DC

Research Consultant, 1997 to 1998

Dr. Metz conducted analyses on juvenile crime trend data.

TEACHING EXPERIENCE

Argosy University, American School of Professional Psychology- Washington, DC

Clinical Adjunct Faculty, 2002 to 2006

Dr. Metz teaches graduate level statistics, research methods, and life span psychology.

Catholic University of America, Department of Psychology- Washington, DC

Instructor, 1998 to 1999

Dr. Metz taught undergraduate courses in psychology.

CLINICAL EXPERIENCE Meyer Treatment Center, Washington School of Psychiatry – Washington, DC Clinician, 2007 to 2008. Dr. Metz provided psychotherapy to adults in a community-based clinic.


HONORS AND AWARDS

Thomas Vernor Moore Doctoral Scholarship Recipient, Catholic University of America, Washington, DC, 1997 - 2000

Received Honors, Doctoral Comprehensive Examinations, Catholic University of America, Washington, DC, 1999

Received Distinction, Oral Defense of Dissertation, Catholic University of America, Washington, DC, 2001

PROFESSIONAL ACTIVITIES Co-Chair, Global Implementation Conference (2015) Evaluation Advisory Board, Youth Guidance Chicago, IL (2015 – present) NIH Grant Reviewer and Review Chair for Implementation and Dissemination Research in Health (2010 – to present) Center for Adoption Support and Education - Training and Certifying Adoption Competent Mental Health

Practitioners: National Advisory Board Doris Duke Charitable Trust/Zero to Three - Promoting Positive Relationships (PPR): Impacting Child Care

Practice: Evaluation Advisory Board Child Care Bureau/OPRE’s Implementation Work Group

Children’s Bureau’s Implementation Science Committee

Practitioner Practice Group for the Global Implementation Conference and Initiative

ASPE Replication and Adaptation Technical Workgroup

Office of Adolescent Health Expert Panel for Teen Pregnancy Prevention

Office of Planning Research and Evaluation Evidence-Based Practice Workgroup

Scientific Advisory Board for the Center for Prevention Implementation Methodology for Drug Abuse

and Sexual Risk Behavior

SELECTED PAPERS, TECHNICAL REPORTS, AND PUBLICATIONS

Metz, A. & Easterling, D. (in press) Using Implementation Science to Translate Strategy into Practice (in

press). Foundation Review. Easterling, D., & Metz, A. (in press). Getting Real with Strategy: Insights from Implementation Science.

Foundation Review. Metz, A. & Bartley, L. (under review). Co-Creating the Conditions to Sustain the Use of Research Evidence

in Public Child Welfare. Child Welfare. Kainz, K. & Metz, A. (under review). An Integrated Embedded Research Agenda for Agile Implementation Frameworks. Evidence & Policy.

Metz. A. (2016). Practice Profiles: A Process for Capturing Evidence and Operationalizing Innovations. White

Paper published by the National Implementation Research Network. http://nirn.fpg.unc.edu/sites/nirn.fpg.unc.edu/files/resources/NIRN-Metz-WhitePaper-PracticeProfiles.pdf?o=implenet

http://nirn.fpg.unc.edu/sites/nirn.fpg.unc.edu/files/resources/NIRN-Metz-WhitePaper-PracticeProfiles.pdf?o=implenet

http://nirn.fpg.unc.edu/sites/nirn.fpg.unc.edu/files/resources/NIRN-Metz-WhitePaper-PracticeProfiles.pdf?o=implenet


Metz, A. (under review). Implementation for Impact: Co-Creating the Infrastructure Needed to Achieve Positive Outcomes in Children’s Mental Health. Invited monograph for Advances in Child and Family Policy and Practice, Springer Publishing.

Supplee, L & Metz, A. (2015). Opportunties and Challenges in Evidence-Based Social Policy. Social Policy

Report, Volume 28, Number 4.

Metz, A., Naoom, S., Halle, T. & Bartley, L. (2015). An Integrated Stage-Based Framework for

Implementation of Early Childhood Programs and Systems. Research Brief for the

Office of Planning, Research and Evaluation, Washington, DC.

Metz, A., Bartley, L., Ball, H., Wilson, D., Naoom, S., & Redmond, P. (2014). Active Implementation Frameworks for Successful Service Delivery. Research on Social Work Practice.

Metz, A. & Albers, B. (2014). What Does It Take? How Federal Initiatives Can Support the

Implementation of Evidence-Based Programs to Improve Outcomes for Adolescents. Journal of Adolescent Health, Vol. 54. No. 3.

Fixsen, D. L., Blase, K. A., Metz, A. J., & Naoom, S. F. (2014). Producing high levels of treatment integrity

in practice: A focus on preparing practitioners. In L. M. Hagermoser Sanetti & T. Kratochwill (Eds.), Treatment Integrity: A foundation for evidence-based practice in applied psychology (pp. 185-201). Washington, DC: American Psychological Association Press (Division 16).

Metz, A., Halle, T., Bartley, L., & Blasberg, A. (2013). The Key Components of Successful

Implementation. In T. Halle, A. Metz & I. Martinez-Beck (Eds.) The Application of Implementation Science to Early Childhood Program and Systems. Baltimore, MD: Brookes Publishing.

Halle, T., Metz, A., & Martinez-Beck, I. (Eds.) (2013) Applying Implementation Science to Early Care

and Education Programs and Systems: Exploring a New Frontier, Brookes Publishing, Baltimore, MD.

Tout, K., Metz, A., & Bartley, L. (2013). Considering Statewide Professional Development Systems

through an Implementation Lens. In T. Halle, A. Metz & I. Martinez-Beck (Eds.) The Application of Implementation Science to Early Childhood Program and Systems. Baltimore, MD: Brookes Publishing.

Halle, T., Zaslow, M., Martinez-Beck, I., Metz, A. (2013). Applications of Implementation Science to Early

Care and Education Programs and Systems: Implications for Research, Policy and Practice. In T. Halle, A. Metz & I. Martinez-Beck (Eds.) The Application of Implementation Science to Early Childhood Program and Systems. Baltimore, MD: Brookes Publishing.

Fixsen, D., Blase, K., Metz, A., & Dyke, M. V. (2013). Statewide implementation of evidence-based

programs. Exceptional Children (Special Issue) Vol. 79, No. 2.

Fixsen, D. L., Blase, K. A., Metz, A. J., & Naoom, S. F. (2013). Fidelity through an implementation lens. In

L. M. H. Sanetti & T. Kratochwill (Eds.), Treatment Integrity: Conceptual, Methodological, and Applied Considerations for Practitioners. Washington, DC: American Psychological Association Press (Division 16).


Metz, A. & Bartley, L. (2012). Active Implementation Frameworks for Program Success: How to use

implementation science to improve outcomes for children. Zero to Three Journal, 34 (4), 11-18.

Metz, A., Blase, K., Bartley. L., Wilson, D., Ball, H., and Redmond, P. (2012). Using Implementation Science to Support and Align Service and System Change: A Study of the Catawba County Child Wellbeing Project. Child Trends Research Brief, Washington, DC.

Wilson, D., Brandes, B., Ball, H., Redmond, P., & Metz. A. (2012). Building the Catawba County Child Wellbeing Project: A Practice Perspective on Using Implementation Science to Promote Systems Change. Child Trends Research Brief, Washington, DC.

Metz, A., Halle, T., Anderson, R., Chrisler, A., and Rothenberg, L. (2011). Evaluation of the

Implementation of the Mentor Infant and Toddler Teachers (MITT) Initiative Year 2 Evaluation Report. Submitted to the Office of Head Start.

Metz, A., Halle, T., & Burkhauser, M. (2010). Evaluation of the Mentor Infant and Toddler Teachers

(MITT) Initiative. Annual Report submitted to the Office of Head Start. Bandy, T., Burkhauser, M., & Metz, A.J.R. (2009). Data-Driven Decision Making in Out-of-School Time

Programs. Washington, DC: Child Trends. Burkhauser, M. & Metz, A.J.R. (2009). Building Systems-Level Partnerships. Washington, DC: Child

Trends. Collins, A. & Metz, A.J.R. (2009). How Program Administrators Can Support Out-of-School Time Staff.

Washington, DC: Child Trends. Metz, A., Burkhauser, M., & Bowie, L. (2009). Training Out-of-School Time Staff. Washington, DC: Child

Trends. Metz, A. J. R., Burkhauser, M., Collins, A. & Bandy, T. (2008). The Role of Organizational Context and

Partnerships in the Implementation of Evidence-Based Practices. Child Trends Special Report. Washington, DC.

Metz, A. J. R., Burkhauser, M., Collins, A. & Bandy, T. (2008). The Role of Organizational Context and

Partnerships in the Implementation of Evidence-Based Practices: an Exploratory Study. Child Trends Special Report. Washington, DC.

Metz, A. J. R., Bowie. L., Burkhauser, M. & Bandy, T. (2008). The Role of Frontline Staff in the

Implementation of Evidence-Based Practices. Child Trends Special Report. Washington, DC. Metz, A. J. R., Bowie. L., Burkhauser, M. & Bandy, T. (2008). The Role of Frontline Staff in the

Implementation of Evidence-Based Practices: An Exploratory Study. Child Trends Special Report. Washington, DC.

Collins-Camargo, C., Ensign, K., Metz, A.J.R., Hall, J.G. (2008) Knowledge

Development and Transfer on Public/Private Partnerships in Child Welfare Service Provision: Using Multi-Site Research to Expand the Evidence Base. Journal of Social Work Professional


Development. Bronte-Tinkew, J., Horowitz, A., and Metz, A. J. R. (2008). “What Works” in Fatherhood

Programs? Ten Lessons Learned from Evidence-Based Practice. National Fatherhood Clearinghouse Brief. Washington, DC.

Bronte-Tinkew, J., Burkhauser, M., and Metz, A. J. R. (2008). Elements of Promising Practices

in Teen Fatherhood Programs: Evidence-Based and Evidence-Informed Research Findings on What Works. Report submitted to the Office of Family Assistance, US Department of Health and Human Services. Washington, DC.

Bronte-Tinkew, J., Burkhauser, M., Mbwana, K., Metz, A. J. R., and Collins A. (2008). Elements

of Promising Practices in Program Serving Fathers Involved in the Criminal Justice System. Report submitted to the Office of Family Assistance, US Department of Health and Human Services. Washington, DC.

Metz, A.J.R., Bowie, L., & Blase, K. (2007). Seven Activities for Enhancing the Replicability of Evidence-

Based Practices. Research to Results Brief, Child Trends, Washington, DC. Metz, A.J.R., Blase, K., & Bowie, L. (2007). Implementing Evidence-Based Practices: Six “Drivers” of

Success. Research to Results Brief, Child Trends, Washington, DC. Metz, A.J.R., Espiritu, R., & Moore, K.A. (2007). What is Evidence-Based Practice? Research to Results

Brief, Child Trends, Washington, DC. Metz, A.J.R. (2007). A 10-Step Guide to Adopting and Sustaining Evidence-Based Practices in Out-Of-

School Time Programs. Research to Results Brief, Child Trends, Washington, DC. Metz, A.J.R. (2007). Why Conduct a Program Evaluation? Research to Results Brief, Child Trends,

Washington, DC. Metz, A.J.R. and Kremer, D. (December 2006). Innovation and Improvement Projects Implementation

Phase: Year One Synthesis Report. Submitted to the Office of Head Start, Washington, DC. Metz, A.J.R. (August 2006). Child Welfare Privatization Outcome Evaluations: Findings, Challenges, and

Recommendations. In the Literature Review on the Privatization of Child Welfare Services. Submitted to the Children’s Bureau, Washington, DC.

Metz, A.J.R. and Ensign, K. (June 2005). Innovation and Improvement Projects Planning Phase

Assessment: Cross-Site Synthesis and Methods for Improving Replication and Evaluation in Implementation. Submitted to the Head Start Bureau, Washington, DC.

Metz, A.J.R. and Ensign, K. (January 2005). Innovation and Improvement Projects Planning Phase

Assessment: Cross-Site Synthesis and Methods for Improving Replication and Evaluation in Implementation. Submitted to the Head Start Bureau, Washington, DC.

Smollar, J. and Metz, A.J.R. (December 2003). Lessons Learned from the First Two Years of the Children’s

Bureau’s Quality Improvement Center Initiative. Submitted to the Children’s Bureau, Washington, DC.


DeSantis, J.P. and Metz, A.J.R. (December 2003). Evaluation of Arizona Families F.I.R.S.T. Community

Substance Abuse Prevention and Treatment Program Final Report. Submitted to the State Legislature, Phoenix, AZ.

Metz, A.J.R. and DeSantis, J.P. (June 2003). Evaluation of Arizona Families F.I.R.S.T. Community

Substance Abuse Prevention and Treatment Program. Annual Report. Submitted to the State Legislature, Phoenix, AZ.

Youniss, J. and Metz, A.J.R. (2002). The Changing Adolescent Experience: Societal Trends and Transition

to Adulthood. In R. Larson, & J. Mortimer, (Eds.) Adolescence in the 21st Century. Cambridge, MA: Cambridge University Press.

Metz, A. J.R. and Youniss, J. (June 2000). Indicators for Positive Youth Development: Assessment of

Adolescent Trend Data. Report prepared for the William T. Grant Foundation. SELECTED PRESENTATIONS

Metz, A. & Turnbull, A. (May 2016). Co-Creating for Change: The Role of Parent Voices in Successfully Implementing Evidence-Based Practices for Inclusion. Keynote Address for National Conference on Inclusion for Early Childhood.

Metz, A. & Schroeder, J. (April 2016). How To: A master class for intermediaries seeking to use

implementation science to impact community change. Blueprints Pre-Conference Workshop, Denver, CO.

Metz, A. (April 2014). What does it take to improve outcomes in early childhood? Keynote Address for

Child Care Aware of American Conference, Washington, DC. Metz, A. (March 2016). What does it take to improve outcomes for STREAMS grantees? Invited

Workshop at Mathematica, Washington, DC. Metz, A. (March 2016). Emerging Areas in Implementation Science. Invited talk for Public Health

Ontario, Toronto, Canada. Metz, A. (February 2016). It Takes a Village: Implementation Teams. Trinity College School of Medicine,

Post Graduate Implementation Science Certificate Program, Dublin, Ireland. Metz, A. (February 2016). Building Staff Competency: The role of selection and coaching in effective

implementation. Trinity College School of Medicine, Post Graduate Implementation Science Certificate Program, Dublin, Ireland.

Metz, A. (February 2016). What Does it Take…To improve outcomes for child welfare? Texas

Department of Protective and Family Services, Austin, TX. Metz, A. & Schroeder, J. (February 2016). How To: A master class for intermediaries seeking to use

implementation science to impact community change. Colorado Implementation Collaborative, Denver, CO.


Metz, A. & Bartley, L. (December 2015). Foundations in Implementation Science. Office of Family Assistance Grantees Meeting, Washington, DC.

Metz, A., (November 2015). Usable Interventions in Implementation: Defining the What. MA

Department of Mental Health, Boston, MA. Metz, A. (October 2015). Building Stakeholder Readiness for Successful Implementation: Part II. Nurture

Health and Wellbeing Programme. Dulbin, Ireland. Metz, A. (October 2015). Active Implementation for Successful Service Delivery. Public Health Agency,

Belfast, Northern Ireland. Metz, A. (October 2015). Coaching for Competency. Office of Special Education Programs, State

Professional Development Grantee Meeting, Washington, DC. Metz, A. (October 2015). Co-Creating the Infrastructure for Implementing

Evidence-Based Practice. American Youth Policy Forum, Congressional Briefing. Washington, DC.

Metz A. (September 2015). Co-Creating the Infrastructure to Optimize the Use of Research Evidence in

Children’s Mental Health. Children’s Mental Health Forum and Harvard Children’s Hosptial, Boston, MA.

Metz, A. (August 2015). Active Implementation for Successful Service Delivery. Presentation for the

Department of Health, Social Services and Public Safety and Health and Social Care Board, Belfast, Northern Ireland.

Metz, A. (August 2015). Building Readiness and Stakeholder Involvement for Successful

Implementation. Workshop for Nurture Health and Wellbeing Programme. Dublin, Ireland. Metz, A. & Fixsen, D. (July 2015). Transformative Impact: Implications from Implementation Science for

Effectively Spreading Programs & Practices. Invited presentation by Bridgespan. Metz, A. & Leah Bartley (July 2015). Logic Models to Support Evidence-Based Interventions.

Presentation for Pennsylvania’s Department of Human Services. Metz, A. & Schroeder, J. (May 2015). How To: A master class for intermediaries seeking to use

implementation science to impact community change. Global Implementation Conference Academy, Dublin, Ireland.

Metz, A. & Collins, D. (May 2015). Co-Creating the Infrastructure for Implementing

Evidence-Based Practice: A Case Study of New York City’s Child Welfare Preventive Services. Global Implementation Conference, Dublin, Ireland.

Metz, A (May 2015). Implementation for Impact. Invited Gailanne Reeh Lecture for Children’s

Behavioral Health Knowledge Center, Boston Department of Mental Health, Boston, MA. Metz, A. (May 2015). Stage-Based Implementation for Improving Mental Health Outcomes. Boston

Department of Mental Health, Boston, MA.


Metz, A. (April 2015). Active Implementation to Improve Child Welfare Outcomes. Invited workshop by

Casey Family Programs, Erie, PA. Metz, A. (April 2015). Building, Improving and Sustaining the Implementation Infrastructure. Invited

webinar for the Florida Department of Children and Families, Behavioral Health Learning Collaborative.

Metz, A. (April 2015). Usable Intervention Criteria. Webinar for the Boston Department of Mental

Health. Metz, A. (April 2015). Co-Creating a Sustainable Infrastructure for Change: The role of stakeholders in

mainstreaming the use of evidence in practice. Keynote for Colorado Child and Adolescent Mental Health Coalition. Denver, CO.

Metz, A. & Schroeder, J. (April 2015). How To: A master class for intermediaries seeking to use

implementation science to impact community change. Colorado Child and Adolescent Mental Health Coalition. Denver, CO.

Metz, A. (April 2015). The Role of Stakeholders in Building Capacity for Early Childhood Home Visiting.

MIECVH and ECCS Grantees Meeting, Kansas City, KS. Metz, A. (April 2015). Co-creating the Infrastructure for Sustainable Early Childhood Home Visiting

Programs. Keynote for MIECHV and ECCS Grantees Meeting, Kansas City, KS. Metz, A. (April 2015). Foundations in Implementation Science. Webinar for the Boston Department of

Mental Health. Metz, A. (March 2015). Usable Intervention Criteria. Invited webinar for the Florida Department of

Children and Families, Behavioral Health Learning Collaborative. Metz, A. (March 2015). Foundations in Implementation Science: Applying Active Implementation to

Improve Outcomes. Invited workshop for Commissioner Office, New Jersey Department of Children and Families.

Metz, A. & Collins, D. (February 2015). Co-Creating the Infrastructure for Implementing

Evidence-Based Practice: A Case Study of New York City’s Child Welfare Preventive Services. Casey Shared Learning Collaborative for Pennsylvania’s Office of Children, Youth and Families.

Metz, A. (February 2015). Foundations in Implementation Science. Invited webinar for the Florida

Department of Children and Families, Behavioral Health Learning Collaborative. Metz. A., Burke, K., & Owens, S. (February 2015). Implementation Workshop

Children and Young People's Services Committees: How well are you implementing? Dublin, Irleand.

Metz, A. (February 2015). Implementation for Impact: Co-Creating the Infrastructure for Achieving

Population Outcomes. Ireland Department of Children and Youth Affairs, Dublin, Ireland.


Metz, A. & Naoom, S. (January 2015). Implementation Science for Improving Public Health Outcomes. Invited three-day workshop for Public Health Ontario, Toronto, Canada.

Metz, A. Supporting Wide-Scale Implementation Strategies in Policy Making: The role of government in

mainstreaming evidence (December 2014). Congressional Briefing, Washington, DC. Metz, A. Stakeholder Involvement: Sustaining Preventive Evidence-Based Models in Child Welfare

(November 2014). New York City’s Administration for Children’s Services, NY, NY. Metz, A. Coaching for Competence and Competent Coaching (November 2014). Casey Shared Learning

Collaborative for Virginia’s Department of Children’s Services, Charlottesville, VA. Metz, A. Active Implementation for Scaling Youth Violence Prevention Programs (October 2015). Invited

workshop for Youth Guidance, Chicago, IL. Metz, A. Active Implementation for Successful Delivery of Mental Health Services (October 2015).

Invited workshop for Boston Department of Mental Health, Boston, MA. Metz, A. Active Implementation for Successful Service Delivery (October 2015). Keynote Address at the

Teaching Family Conference, Charlotte, NC. Metz, A. Co-Creating the Infrastructure for Using and Sustaining Evidence in Practice (October 2015).

Invited workshop at the Teaching Family Conference, Charlotte, NC. Metz, A. Mainstreaming Evidence into Complex Service Systems: Using Evidence in Context (September

2014). New South Wales Boardroom Conversation, Sydney, Australia. Metz, A. The Role of Key Stakeholders in Co-Creating an Infrastructure to Support Evidence-Based

Practice (September 2014). Invited Pre-Conference Workshop for the Australian Implementation Conference, Sydney, Australia.

Metz, A. The Role of Stakeholders in Mainstreaming Evidence in Child Welfare (September 2014). Paper

presented at the Australian Implementation Conference, Sydney, Australia. Metz A. Active Implementation: Technical Assistance and Implementation Support (September 2014).

Invited Plenary for Mathematica’s Center for Implementation Research and Evaluation, Washington, DC.

Metz, A. What’s New in Implementation? (July 2014). Invited Presentation for the Irish Implementation

Network, Dublin, Ireland. Metz, A. Active Implementation for Successful Service Delivery in Foster Care (June 2014). Invited

Presentation for the Fostering Network and Regional Adoption Taskforce, Belfast, Northern Ireland.

Metz, A. Active Implementation for Successful Service Delivery (June 2014). Invited Presentation for the

Children and Young People Strategic Partnership, Belfast, Northern Ireland. Metz, A. Leading with a Theory of Change: The role of needs assessments in selecting models (April


2014). Invited presentation for the Youth At-Risk of Homelessness Initiative, Office of Planning Research and Evaluation and the Children’s Bureau, Washington, DC.

Metz, A. Co-Creating the Infrastructure for Change: Scaling Evidence-Based Preventive Services in NYC.

Invited Symposium for Blueprints Conference, Denver, CO. Metz, A. Leadership for Lasting Change (March 2014). Invited Workshop for Regional MIECHV

(Maternal, Infant, and Early Childhood Home Visiting) Grantees, Washington, DC. Metz, A. & Van Dyke, M. Applying Implementation Science to Achieve Systems Change (March 2014).

Invited 3-day workshop for the Office of Juvenile Justice and Delinquency Prevention, Forum on Youth Violence, Washington, DC.

Metz, A., McNeil Miller, K., Benton-Clark, J. The 21st Program Officer (February 2014). Invited

Symposium North Carolina Grantmakers for Health Conference, Greensboro, NC. Metz, A. Developing, Improving, and Sustaining the Implementation Infrastructure for Alternative

Response (January 2014). Invited Workshop for Washington State’s Children’s Administration, Seattle, WA.

Metz, A. Usable Interventions in Implementation: Defining the “IT” (January 2014). Invited Workshop for

Washington State’s Children’s Administration, Seattle, WA. Metz, A., McNeil Miller, K., Benton-Clark, J. The 21st Program Officer (November 2013). Symposium for

the Southeastern Council of Foundations, Virginia. Metz, A. Active Implementation of Effective Social Work Practice: A Case Study of the Co-Creation of the

Implementation Infrastructure in New York City (November 2013). Invited Workshop for the Ministry of Health and Social Affairs.

Metz, A. Implementation and Scaling for Social Impact: Creating an Agenda for Implementation

Researchers (November 2013). Invited Workshop for the Ministry of Health and Social Affairs, Stockholm, Sweden.

Metz, A. Active Implementation Frameworks for Successful Service Delivery: A case study of the

Catawba County Child Wellbeing Project (November 2013). Invited Plenary for the International Scientific Conference on Cannabis and Health, Stockholm, Sweden.

Metz, A. A Case Study of the Catawba County Child Wellbeing Project (October 2013). Division of Early

Childhood Annual Meeting, San Francisco, CA. Metz, A. Active Implementation Frameworks for Successful Service Delivery: A case study of the

Catawba County Child Wellbeing Project. Invited Plenary for the Irish Implementation Network Meeting, October 2013.

Metz, A. Co-Creating the Infrastructure to Support Positive Outcomes for Children and Families (October

2013). Invited presentation for the Centre for Effective Services, Dublin, Ireland. Metz, A. So You Thought You Were Ready? The role of readiness in implementation of evidence-based


practices (September 2013). Invited presentation for NYC’s Administration for Children’s Services, New York, New York.

Metz, A. Active Implementation for Successful Service Delivery (August 2013). Global Implementation

Conference, Washington, DC. Metz, A. Foundations in Implementation Science: Effective Strategies for Implementing EBPs (August

2013). Invited Presentation for the National Association of State Mental Health Program Directors, Washington, DC.

Metz, A. Using Implementation Science as a Frame for Quality Improvement: A Look at Georgia’s CCR&R

Network (August 2013). Invited Presentation for the National QRIS Meeting. Washington, DC. Metz, A. Building a Sustainable Infrastructure for the Good Behavior Game (July 2013). Invited Plenary

for SAMHSA’s Summer Training Institute. Washington, DC. Metz, A. Tran, R., Angeles, F. Breakthrough Strategies to Create a Meaningful Learning Environment

(June 2013). Symposium for Grantmakers for Effective Organizations, Miami, FL. Metz, A. Active Implementation Frameworks for Successful Service Delivery: A Case Study of the

Catawba County Child Wellbeing Project. (April 2013). Invited plenary, Bridging the Research to Practice Gap Symposium, Houston, Texas.

Metz, A. Foundations in Implementation Science. (March and April 2013). Invited presentation by Casey

Family Programs, Washington, DC and Seattle, Washington. Metz, A. Usable Intervention in Implementation: Defining the IT. (March and April 2013). Invited

presentation by Casey Family Programs, Washington, DC and Seattle, Washington. Metz, A. Developing, Installing and Improving the Infrastructure. (March and April 2013). Invited

presentation by Casey Family Programs, Washington, DC and Seattle, Washington. Metz, A. Leadership and Implementation Teams for Lasting Change. (March and April 2013). Invited

presentation by Casey Family Programs, Washington, DC and Seattle, Washington. Metz. A. Developing, Measuring, and Improving Program Fidelity: Achieving positive outcomes through

high-fidelity implementation (March 2013). Invited Plenary, State Professional Development Grantees Meeting, Office of Special Education Programs, US Department of Education, Washington, DC.

Metz. A. “Making it Happen” Using Active Implementation Frameworks to Improve Outcomes for

Students (March 2013). Invited Webinar, National TA Center on Mental Health Promotion and Youth Violence Prevention, Prevention Practices in Schools Initiative, Substance Abuse and Mental Health Services Administration, US Department of Health and Human Services.

Metz. A. Developing, Installing and Improving the Infrastructure to Support Community Mental Health

Services. (February 2013). Invited Webinar, Kentucky Department of Behavioral Health, Developmental and Intellectual Disabilities.


Metz. A. Measuring, Assessing, and Improving Implementation and Multiple Levels of the Service

Delivery System (February 2013). Nordic Implementation Conference, Linkoping, Sweden. Metz. A. Active Implementation of Effective Social Work Practices (February 2013). Invited Plenary,

Nordic Implementation Conference, Linkoping, Sweden. Metz. A. Building Implementation Capacity to Support Community Mental Health Services. (January

2013). Invited Webinar, Kentucky Department of Behavioral Health, Developmental and Intellectual Disabilities.

Metz. A. Active Implementation to Support the Implementation of Solution-Based Casework.

(December 2012). Invited Presentation, NYC Administration for Children Services, New York, New York.

Metz. A. Building Implementation Capacity to Improve Youth Outcomes. (December 2012). Invited

Presentation, National Forum on Youth Violence Prevention, OJJDP, Washington, DC. Metz. A. Setting the Stage: Active implementation frameworks to support and sustain the

implementation of evidence-based home visiting models. (December 2012). Invited Presentation, Montana Department of Public Health, Missoula, Montana.

Metz. A. Active Implementation to Support the Implementation of Solution-Based Casework.

(December 2012). Invited Presentation, NYC Administration for Children Services, New York, New York.

Metz. A. Bringing the Evidence to Your Practice: The role of evidence-based programs, kernels, and

elements in changing behavior. (November 2012). Invited Presentation, NYC Office of Mental Health, Bureau of Children, Youth and Families, New York, New York.

Metz. A. Setting the Stage: Active implementation frameworks to support the successful

implementation of EBMs in NYC. (November 2012). Invited Presentation, NYC Administration for Children Services, New York, New York.

Metz. A. Leading Systems Change: Building implementation capacity to support and sustain effective

implementation. (November 2012). Invited Presentation, Regional Meeting for the Maternal, Infant, Early Childhood Home Visiting National TA Center.

Metz. A. Measuring, Assessing, and Improving Implementation and Multiple Levels of the Service

Delivery System (October 2012). Australian Implementation Conference, Melbourne, Victoria. Metz. A. Applications of Implementation Principles and Frameworks: Lessons, Musings, and Questions

(October 2012). Invited Presentation, Parenting Research Centre, Melbourne, Victoria. Metz. A. & Bartley, L. Setting the Stage for Change: Developing Readiness for High-Fidelity

Implementation of EBMs (April 2012). Invited presentation, Evidence-Based Symposium, New York City Administration for Children’s Services.


Metz. A. Creating a Framework for Early Childhood Quality: The Cascading Logic Model. (April 2012). Invited presentation at internal meeting on early childhood quality for the Office of Planning, Research, and Evaluation.

Metz. A. Setting the Stage: Active Implementation Frameworks to Integrate the Science and Practice of

Implementation (March 2012). Invited webinar for the Maternal Infant & Early Childhood Home Visiting Training and Technical Assistance Center.

Metz, A. Developing, Measuring, and Improving Program Fidelity: Achieving Positive outcomes through

high-fidelity implementation (March 2012). State Professional Development Grants National Meeting, US Department of Education, Washington, DC.

Metz, A. Sustaining Effective Programs and Services that Promote Young Child Wellness. (February

2012). Invited webinar for the Substance Abuse and Mental Health Services Administration Project LAUNCH.

Metz, A. “Making It Happen”: Using Active Implementation Frameworks to Improve Outcomes for

Children and Families (January 2012). Invited presentation, Evidence-Based Symposium, New York City Administration for Children’s Services.

Metz, A. Setting the Stage: Active Implementation Frameworks to Integrate the Science and Practice of

Implementation (November 2011). Invited 2-day training workshop for the Southern Coast Addiction Technology Transfer Center, Miami, Florida.

Metz, A. Scaling-Up an Alternative Response Child Welfare Model Statewide

Pay Now or Pay Later…(November 2011). Invited Webinar, Duke University National Center for Child Traumatic Stress, Sustaining Evidence Based Practice Series.

Metz, A., Bartley, L., Blase, K., and Fixsen, D. Practice Profiles: Implementing, Coaching, and Evaluating

New Practices (November 2011). Permanency Innovations Initiative Grantees Meetings, Children’s Bureau, Washington, DC.

Metz, A. & Halle, T. Effectively Implementing Effective Early Care and Education Strategies So

That…(November 2011). Key Note Address for Child Care Policy Research Consortium, Bethesda, Maryland.

Metz, A. Scaling-Up an Alternative Response Child Welfare Model Statewide

Pay Now or Pay Later…(August 2011). Invited Plenary Session for Practitioner Practice Group, Global Implementation Conference, Washington, DC.

Metz, A. Implementing Effective Early Care and Education Professional Development Systems So

That…(July 2011). Invited speaker for INQUIRE, Washington, DC. Metz, A. & Halle, T. Getting from Here to There: Installing an integrated systems framework to

improving teacher practice (June 2011). Invited Session, NAEYC PDI, Providence, Rhode Island. Metz, A., Naoom, S., & Van Dyke, M. (March 2011). “Making It Happen” to Improve Outcomes for

Children Implementation Science and Evidence-Based Practice. Key Note Address for


Implementation Science Summit: Turning Knowledge into Action for Improving Child Outcomes: Implementing Evidence-Based Practice. Melbourne and Sydney, Australia.

Metz, A., Naoom, S., and Van Dyke, M. (March 2011). Using Implementation Science to Execute and

Sustain a Post-Care Service System: Achieving Good Results the First Time. Invited Presentation for the Parenting Research Centre. Melbourne, Australia.

Metz, A., Naoom, S., and Van Dyke, M. (March 2011). Scaling-Up Alternative Response in Ohio Drivers

Exploration Results. Invited Presentation for the Parenting Research Centre. Melbourne, Australia. March 2011.

Metz, A. & Wilson, D. (March 2011). Using Implementation Science to Execute and Sustain a Post-Care

Service System: A “How To” Guide from Catawba County. Prevent Child Abuse North Carolina Learning and Leadership Summit, New Bern, NC.

Metz, A., Blase, K., Fixsen, D., and Van Dkye, M. (February 2011). A Framework for Implementing and

Sustaining Evidence-Based Practices. SAMHSA Project Launch Grantee Adjunct Meeting. Albuquerque, NM.

Blase, K. & Metz, A. (December 2010). Learning By Doing: Using Implementation Science in the Real

World. The Children’s Bureau’s T/TA Exploration Workgroup, Metz, A. (December 2010). Implementation Science: Strategies for Effective Training and Technical

Assistance. The Children’s Bureau’s Training and Technical Assistance Coordination Center, Metz, A., Blase, K., Fixsen, D., and Van Dyke, M. (September 2010). Core Components for Successful

Implementation: Applying Core Implementation Components in ECE research, evaluation, and technical assistance. Office of Planning Research and Evaluation and the Child Care Bureau: Working Meeting on the Application of Implementation Science to Early Care and Education Research.

Metz, A. (August 2010). Setting the Stage for Change…Getting from here to there. Ashtabula County

Children’s Services. Metz, A. (August 2010). Alternative Response: System and Practice Change through an Implementation

Lens. Ashtabula County Children’s Services.

Metz, A., Blase K., Fixsen, D., Horner R., & Sugai, G. (July 2009). Implementation Drivers, SPDG Meeting, Program Directors Conference, OSEP, Department of Education, Washington, DC.

Metz, A., Blase, K., Fixsen, D., Van Dyke, M., Duda, M., & Naoom, S. (November 2009). Implementation and Systems Change to Support Effective Service. Invited Instructor, Bridging the Gap: Research, Practice and Policy Symposium, Mental Health Connection of Tarrant County, Dallas, Texas.

Metz, A., Blase, K., Van Dyke, M. (November 2009). Systems and Practice Change through an Implementation Lens. Invited Trainer, Mountains and Plains Child Welfare Implementation Center, Denver, Colorado.

Metz, A., Blase, K., Van Dyke, M. (December 2009). Systems and Practice Change through an Implementation Lens: Implementing and Scaling Up Alternative Response in Ohio. Invited


Trainer, American Humane Association, Ohio Alternative Response Leadership Council, Columbus, Ohio.

Neal, M., Britt, D., & Metz, A. (December 2009). Mentoring Infant Toddler Teachers Initiative: Online Modules for Teachers of our Youngest Children. Presentation, Birth to Three Conference, Dallas, Texas.

Metz, A., Van Dyke, M., Blase, K., & Fixsen, D. (January 2010). Leading in Context: The Science of Implementation, Invited Trainer, Leadership Academy for Middle Managers, The National Child Welfare Leadership Institute, New York, New York.

Metz, A., Blase, K., Van Dyke, M. (March 2010). Implementation and Systems Change to Support Effective Service: The Science of Implementation, Keynote Address, Mountains and Plains Child Welfare Implementation Center Roundtable Meeting, Denver, Colorado.

Metz, A., Blase, K., Van Dyke, M. (March 2010). Systems and Practice Change through an Implementation Lens: The Colorado Child Welfare Practice Initiative. Invited Trainer, Mountains and Plains Child Welfare Implementation Center, Colorado Practice Initiative, Denver, Colorado.

Metz, A., (March 2010). The Road to Results: Using the Science and Practice of Implementation to Make a Lasting and Positive Difference in our Communities, Invited Presentation, The Duke Endowment, Charlotte, North Carolina.

Metz, A., Blase, K., Van Dyke, M. (April 2010). Defining and Installing the “IT:” Using Implementation Drivers for Systems Change, Webinar, Mountains and Plains Child Welfare Implementation Center, Denver, Colorado.

Metz, A., Blase, K., Van Dyke, M. (May 2010). Systems and Practice Change through an Implementation Lens: The Colorado Child Welfare Practice Initiative. Invited Trainer for Colorado Counties, Mountains and Plains Child Welfare Implementation Center, Colorado Practice Initiative, Denver, Colorado.

Metz, A., Blase, K., Van Dyke, M. (April 2010). Installing Alternative Response in Ohio: Using Implementation Drivers for Systems Change, Invited Workshop, American Humane Association, Alternative Response Summit, Columbus, Ohio.

Metz, A., Blase, K., Van Dyke, M. (May 2010). Alternative Response: Systems and Practice Change through an Implementation Lens, Plenary Presentation, American Humane Association, Alternative Response Summit, Columbus, Ohio.

Metz, A., Blase, K., Fixsen, D., & Duda, M. (June 2010). The Road to Results: Using the Science and Practice of Implementation to Make a Lasting and Positive Difference in our Aging Communities, Invited Presentation, FUTURAGE Conference, Center for Aging and Supportive Environments, Lund University, Sweden.

Metz, A. J. R. (April 2008). Adopting, Implementing, and Replicating Fatherhood Curricula. National

Responsible Fatherhood Clearinghouse Webinar. Washington, DC. Bronte-Tinkew, J. and Metz, A. J. R. (June 2008). 10 Steps for Evaluating Fatherhood Programs. National

Responsible Fatherhood Clearinghouse Webinar. Washington, DC. Metz, A. J. R. (March 2008). Effective Strategies for Implementing Evidence-Based Practices: A 10-Step

Guide. Promising Practices-Proven Strategies Conferences Harrisburg, PA.


Metz, A. J. R. (March 2008). Effective Strategies for Implementing Evidence-Based Practices: A 10-Step Guide. The National Afterschool Association Conference. Ft. Lauderdale. FL.

Metz, A. J. R. (September 2007). Implementing Evidence-Based Practices in Youth Programs:

Understanding “What Works” for Effective Program Implementation. The Performance Institute. Arlington, VA.

Metz, A.J.R. (November 2005). Evaluation for Program Managers. Understanding and applying

evaluation strategies to assess your program’s implementation and outcomes. Presented at the Abstinence Education Conference. Washington, DC.

Ensign, K., Metz, A.J.R., Macomber, J.E. (June 2005). An Overview of the National Evaluation of the

Court Improvement Program. Meeting of the States and Tribes. Washington, DC. Metz, A.J.R. (March 2004). Replication of Family Connections: A Cross-Site Evaluation Framework.

Children’s Bureau Grantees Conference. Washington, DC. Metz, A.J.R. (December 2003). Replication of Demonstrated Effective Prevention Program: Technical

Assistance on Evaluation. Children’s Bureau Grantees Conference. Washington, DC. Metz, A.J.R. and Kaye, E. (March 2003). Technical Assistance on Evaluation. Children’s Bureau Grantee

Conference. Washington, DC. Metz, A.J.R. (2002). , A Longitudinal Study of Adolescent Relationships. 2002 Biannual meeting of the

Society for Research on Adolescence. New Orleans, LA. Youniss, J., Reis, O., and Metz, A.J.R. (October 2001). Accounting for Longitudinal Patterns in Adolescent

Identity. Sundance. Salt Lake City, Utah. Metz, A.J.R. (July 2000). Adolescent Identity Development and Community Service. Annual meeting of

the Association for Moral Education. Glasgow, Scotland. Metz, A.J.R. (November 1999). Assessing Inter-rater Reliability in a Multi-Site Study. Annual meeting for

the American Evaluation Association. Orlando, FL. Metz, A. J.R., and McLellan, J. (April 1998). The Developmental Effects of Short Term Community Service

in Adolescence. Biannual meeting of the Society for Research on Child Development. Albuquerque, NM.

Documents

ALLISON METZ, Ph.D. National Implementation Research ... Metz... · Allison Metz, Ph.D., is a developmental psychologist, Director of the National Implementation Research Network,