Competency-Based Reforms of the Undergraduate Biology and Premedical Curriculum Michael Gaines...

Competency-Based Reforms of the Undergraduate Biology and

Premedical Curriculum

Michael Gaines William LaCourse David Sanders Katerina Thompson

• Bio2010: Active learning and interdisciplinary curricula

• SFFP: Integrative competencies rather

• V&C: Core concepts and

competencies

• PCAST: Focus on first two years of undergraduate STEM education

SFFP undergraduate pre-medical student competencies

1: Quantitative reasoning 2: Scientific inquiry3: Physics4: Chemistry5: Molecular biology6: Structure and function7: Sense and behavior8: Evolution

Competency E8Demonstrate an understanding of how the organizing principle of evolution by natural selection explains the diversity of life on earth.

Competency E8Demonstrate an understanding of how the organizing principle of evolution by natural selection explains the diversity of life on earth.

Learning objective 1: Explain how genomic variability and mutation contribute to the success of populations.

Learning objective 2: Explain how evolutionary mechanisms contribute to change in gene frequencies in populations and to reproductive isolation.

Biological & Biochemical

Foundations of Living Systems

Chemical & Physical

Foundations of Biological Systems

Psychological, Social, & Biological

Foundations of Behavior

Critical Analysis & Reasoning

Skills

Big changes are coming to the MCAT in 2015

Eliminates writing sample

ADDED

• Development of competency-based modules for undergraduate life science courses

• Piloting of modules

• HHMI on-line resource bank for implementing competency-based life science courses at other institutions

Goals of the NEXUS project

Chemistry Math

Physics

Biology

CaseStudies

Linking the Physical and Biological Sciences in the Undergraduate Biology Curriculum: A

Redesigned Introductory Physics Course for Biology Students

• Build on an existing, reformed physics class that already stresses competency building (but lacks a strong focus on interdisciplinarity)

• Strengthen interdisciplinarity by – Requiring calculus, introductory biology, and introductory

chemistry as pre-requisites

– Negotiating course content with biologists and chemists

• Help students see physics as a way of – Strengthening general scientific competencies

– Gaining a deeper understanding of biological phenomena

Creating a new physics sequence

Content decisions

Expand or include Reduce or eliminate

• Atomic and molecular models of matter

• Energy, including chemical energy• Fluids, including fluids in motion and

solutions• Diffusion and gradient driven flows• More emphasis on dissipative forces

(viscosity)• Electrostatics in fluids• Kinetic theory, implications of

random motion, statistical picture of thermodynamics

• Projectile motion• Universal gravitation• Inclined planes, mechanical

advantage• Linear momentum• Rotational motion• Torque, statics, and angular

momentum

Course structure

• A wikibook for student readings– Students read 2-3 webpages before each class

and write a brief summary and question for each.• Homework and recitation problems that do

physics skill development in biological contexts– How big is a worm?– Moving listeria

• In-class clicker (peer instruction) problems

Revised laboratory curriculum

First Semester: Exploring directed motion, random motion, and forces

Second semester: Exploring buoyancy, microfluidics, and optics

• Analyzing biological motion videos

• Understanding and quantifying random motion

• Determining mass of unknown materials from random motion

• Random vs. directed motion

• Terminal velocity and the balance of forces

• Constructing microfluidic chambers to examine fluid flow and diffusion

• Using acrylic beads that are lighter than the surrounding fluid

• Phase contrast microscopy

Course resourcesNEXUSphysics.umd.edu

• Full semesters• “Threads” on specific topics

– Estimation and quantification– Energy and chemical bonds– Gradient driven flow– Action potentials

• Lab curriculum (under development)

Assessment plan

• Do they still learn physics?– Force and Motion Conceptual Evaluation (FMCE)

• Do they have a greater appreciation for the interdisciplinary nature of modern biology?– MPEX2 Interdisciplinary Cluster

• Does their understanding of physics help them make better sense of biological phenomena?– Rubric-graded student artifacts that are indicators

of specific scientific competencies

Do they still learn physics?

FMCE Force Questions FMCE Energy Questions0%

10%

20%

30%

40%

50%

60%

70%

80%

NEXUS pilot course (N=20)

Reformed traditional course (N=189)

Traditional course (N=201)

Frac

tion

of p

ossi

ble

gain

Do they have a greater appreciation for the interdisciplinary nature of modern biology?

(Expert)

(Less Expert)

Hall, Cooke & Redish (in prep)

How successful were the labs in helping you achieve these goals?

Interpret data

Work in groups

Understand concepts

Communicate ideas

Design experiments

Prepare for future career

0%10%

20%30%

40%50%

60%70%

80%90%

100%

LowMediumHigh

% of students

Moore, Giannini, & Losert (submitted)

Experiments Exploring the Use of Quantitative Modeling Core Competency Development in

Select Foundational Courses

College of Natural and Mathematical Sciences

Team Members: Dean Bill LaCourse Asst. Dean Kathy Sutphin

Jeff Leips (Biology) Sarah Leupen (Biology) Kathleen Hoffman (Mathematics and Statistics) Kathy Dowell (Assessment)

Develop 11 active learning modules to introduce a competency-based curriculum into active learning environments for two introductory biology courses:

• Biology 141 – Foundations of Biology: Cells, Energy and Organisms

• Biology 142 – Foundations of Biology: Ecology and Evolution

Mathematical modeling and quantitative reasoning

Focus on SFFP competency E-1 (quantitative reasoning) while incorporating other competencies E-2 to 8, as appropriate

Biology 141 Modules

• Introduction to Mathematical Modeling• Mendelian Genetics• Animal Physiology—Size and Surface Area• Cell Structure and Function—How to Escape a Jaguar• Transcription and Translation (in revision)• Plant Physiology-Photosynthesis• Diffusion in Biological Systems

Biology 142 Modules

• Introduction to Mathematical Modeling**• Biodiversity*• Population Genetics I – Breeding Bunnies (Natural

Selection)**• Population Genetics II—Migrating Bunnies (Genetic

Drift and Migration)**

** Piloted and summative assessment completed* Piloted

Module components designed for ease of adoption and adaptation

• Tutor Guide– Module Content– Alignment to HHMI Competencies– Table of Contents

• Module Worksheet• Pre-lab Review Questions / Quizzes• Suggested Questions for Formative Assessment• Guide for Implementation

Each Module is formatted as follows:

Current Assessment Plan:• Formative Assessment:

- Two - four graded questions from each module thatassess specific objectives covered in the module

- Student Attitude Assessment

• Summative Assessment:Pre and post assessment exam given on the first and lastday of class

• Pre/Post Assessment~ 30 questions on demographics/prior coursework/transfer(information obtained in separate questionnaire)~ 30 questions (~15 to assess specific competencies)

Assessment Results: Attitude

Example: Pre-post Assessment Validation

DISSEMINATION

Workshop at UMCP – October 22, 2013: 20 attendees

Developing Modules for a Competency-based, Biochemically-focused Chemistry

Curriculum for Premedical and Life Science Undergraduate Students

QUESTIONS TO PONDER

• How has the Biology curriculum changed in the last 30 years?

• How have the Chemistry, Physics, and Mathematics curricula for Life-Science students changed in the last 30 years?

Biological & Biochemical

Foundations of Living Systems

Chemical & Physical

Foundations of Biological Systems

Psychological, Social, & Biological

Foundations of Behavior

Critical Analysis & Reasoning

Skills

Big changes are coming to the MCAT in 2015

1 – 2 – 1 Purdue Curriculum for Life Science Students

Competency-based, biochemically-focused chemistry curriculum for premedical and life science students

Motivations and Rationale Driving Curricular Change

• Traditional general chemistry and organic chemistry courses were not serving the needs and interests of life science students –- e.g., the organic chemistry was focused on transforming students into synthetic organic chemists rather than preparing them for biochemistry

• Desire to have students take biochemistry immediately after organic chemistry to prepare them for advanced study in biology/biochemistry and undergraduate research.

Chemistry CompetencyCompetency E4:

Demonstrate knowledge of basic principles of chemistry and some of their applications to the understanding of living systems.

Learning Outcome 1: Demonstrate knowledge of atomic structure

Learning Outcome 2: Demonstrate knowledge of molecular structure

Learning Outcome 3: Demonstrate knowledge of molecular interactions

Learning Outcome 4: Demonstrate knowledge of thermodynamic criteria for spontaneity of physical processes and chemical reactions and the relationships of of thermodynamics to chemical equilibrium.

Learning Outcome 5: Demonstrate knowledge of principles of chemical reactivity to explain kinetics and derive possible reaction mechanisms.

Learning Outcome 6: Demonstrate knowledge of the chemistry of carbon-compounds relevant to their behavior in an aqueous environment Learning Outcome 7: Explain the chemical principles that allow structural inference about bio-organic molecules

Biochemistry Competency

Competency E5: Demonstrate knowledge of how biomolecules contribute to thestructure and function of cells.

Learning Outcome 1: Demonstrate knowledge of the structure, biosynthesis, and degradation of biological macromolecules.

Learning Outcome 2: Demonstrate knowledge of the principles of chemical thermodynamics and kinetics that drive biological processes in the context of space (i.e., compartmentation) and time: enzyme-catalyzed reactions and metabolic pathways, regulation, integration, and the chemical logic of sequential reaction steps.

Does CHM109 Effectively Prepare Students for Success in Organic

Chemistry?

• Data demonstrate no significant difference between performance in organic chemistry for those that took CHM 109 or the traditional two semester sequence.

Free-standing Modules for Chemistry CurriculumGeneral Chemistry

Acid/BaseAvailable

KineticsIn Progress

Redox Thermodynamics

Organic Chemistry Acid/Base

Available Intermolecular Interactions

In Progress Biological Leaving Groups Biochemical Pathways & Cofactors

All modules provided with: 1) stated goals and outcomes, 2) module content, 3) accessory problems and, 4) validated assessment tools. Some modules will have an accompanying laboratory.

Ongoing Challenges

Getting buy-in from stakeholder life science departments Keeping open active lines of communicationPreventing “turf” battles

Maintaining resource “neutrality” (e.g. TA lines)Handling large class size: ~450, Fall 2013Effectively assessing learning in large classDeveloping guided-inquiry labs for large class

Overcoming resistance in Chemistry departments based upon tradition

Teaching and Assessing the SFFP Competencies for Preparing Scientists

and Health Professionals

• Advanced Program for Integrated Science and Math (PRISM)

• the Honors Program in Medicine (HPM)

• 90% of undergraduate science majors are pre-medical

• unique collaboration among basic science and medical school faculty

An Ideal Setting for NEXUS:

Cycling (biology, chemistry, math)Diabetes (biology, chemistry, math)Evolution (biology, chemistry, physics)Free Diving (biology, chemistry, math)Milk (biology, chemistry)Ocean Acidification (chemistry, math)Smart Pills (biology, chemistry, math)Strep Throat (biology, math)

Case studies use medically-oriented scenarios to assess student competency.

Case studies are implemented in multiple forums.

• PRISM biology & chemistry workshops• PRISM calculus computer lab sessions• Biology/math-based workshops (general biology course)• Chemistry for the Life Sciences course workshops• Large lecture class recitation sessions• Non-majors biology course (in progress)

• Competency achieved by PRISM students will be greater than that achieved by traditional pre-medical students and HPM students with matching SAT scores.

• Three experimental groups

• Pre- and post-surveys, focus groups, course performance, and MCAT scores

Hypothesis and Study Design:

0

10

20

30

40

50

60

70

80

90

100

"The case modules are effective."

Bad BloodDiabetesEvolutionFree DivingOcean AcidificationSmart PillsStrep Throat

% o

f Stu

dent

s

Case Study

Disagree Unsure Agree

0

10

20

30

40

50

60

70

80

90

100

"The case modules provide opportunities for application of critical thinking skills."

Bad BloodDiabetesEvolutionFree DivingOcean AcidificationSmart PillsStrep Throat

% o

f Stu

dent

s

Disagree Unsure Agree

Case Study

Disagree Unsure Agree0

10

20

30

40

50

60

70

80

90

100

Improvement in effectiveness of case stud-ies after faculty editing

Smart Pills (Fall 2011)Smart Pills (Fall 2012)Ocean Acidification (Fall 2011)Ocean Acidification (Fall 2012)

% o

f Stu

dent

s

• Case studies – reinforce concepts learned– relate concepts they learn to real world situations

• Students– appreciate the integration of the sciences– like how they are challenged to think critically– feel that clarity and organization of case studies need

improvement– think some questions are too vague and the required

math is too difficult

Student Feedback

• Able to answer all case study questions• Rated case studies highly and felt they were effective

in integrating the sciences and math– Integration similar to MCAT passages

• Took between 1 and 10 hours to complete a case study• Suggestions

– More background information– Some questions need better clarification or

additional pointers

Student Experts

• Faculty commitment is difficult due to other obligations and responsibilities.

• Case study implementation is constrained by limited

class time.

Challenges

• Improving integration of case studies into curriculum

• Better preparation of case study facilitators

• Focus groups for students, case study facilitators, and faculty

• New case studies with physics under development

• Summative evaluation – comparison of MCAT scores across the three experimental groups to quantitate student learning and competency

In Progress and Future Steps

Dissemination• Faculty from each institution will visit other

institutions to assist in initial implementation of modules.

• We will adopt and adapt modules from partner institutions.

Chemistry Math

Physics CaseStudies

Biology

http://www.hhmi.org/grants/office/nexus/

nexus@hhmi.org

NEXUS project information and updates:

Discussion Questions

1. What is a competency?2. What are the external incentives for developing a

competency-based curriculum?3. How does a competency-based curriculum differ

from what is already in place at your institution?4. What are the opportunities and challenges of

implementing a competency-based curriculum? 5. How might learner competency best be assessed?

current MCAT

# of Test Items

Testing Time

(minutes)

Biological Sciences

52 70

Physical Sciences 52 70

Verbal Reasoning 40 60

Writing Sample

2 essays 60

Total Content Time 4 hours, 20

minutes

MCAT 2015# of Test

Items

Testing Time

(minutes)

Biological & Biochemical Foundations of Living Systems

65 95

Chemical & Physical Foundation of Living Systems

65 95

Lunch Break

Critical Analysis & Reasoning Skills 60 90

Psychological, Social, & Biological Foundations of Behavior

65 95

Total Content Time 6 hours, 15 minutes

The collaborationUniversity Focus SFFP

Competencies

Purdue Univ. Development of an Undergraduate Chemistry Curriculum and Associated Learning Resources for the Life Sciences

E1.1, E1.5, E2.1–4, E3.5, E4 (all), E5.1, and E7.1

Univ. of MD, College Park

Linking the Physical and Biological Sciences in the Undergraduate Biology Curriculum

E1-E3, E4.4, E4.6, E5.2, E6.4, E7.1-2

UMBC (Univ. of MD, Baltimore County)

Experiments Exploring the Use of Quantitative Modeling Core Competency Development in Select Foundational Courses: The introduction of mathematical modeling in core introductory biology courses

E1-primary; E2-E8 - ancillary

Univ. of Miami

Teaching and Assessing the SFFP Scientific Foundations for Future Physicians Competencies for Entering Medical Students: The development of capstone case studies for integrating and assessing the competencies of biological science students.

E1-8

Pedagogy of competency-based learning

Infuse math throughout the

curriculum

Operationalize skills

Develop skills into competencies

• Interdisciplinary

• Active learning

BIO 2010 (2003) urged transformation of the undergraduate biology curriculum.

Scientific Foundations for Future Physicians (2009) addressed the constraints to

curriculum transformation.• Emphasizes eight

competencies rather than courses

• Allows flexibility in designing curricula

• Shift from teaching stand alone subjects to teaching integrative science competencies

• Articulates core concepts and competencies

• Encourages student-centered learning

• Promotes institutional commitment to change

• Engages the national community in implementing a shared vision

Vision & Change (2011) provided a framework for instituting curricular change.

PCAST Engage to Excel (2012) proposed strategies to increase STEM college graduates.

• Improve first two years of undergraduate STEM education

• Adoption of evidence-based teaching practices

• Lab course with authentic research

• Diversify pathways to STEM careers