Upload
philip-johnston
View
213
Download
0
Embed Size (px)
Citation preview
FORMATIVE ASSESSMENTOF A COMPUTER-AIDED
ANALYSIS CENTER: PLAN DEVELOPMENT AND
PRELIMINARY RESULTS
Dr. Joan Burtner
Industrial Engineering
Project Evaluator
NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 2
Advanced Engineering Analysis Center
Vision Energetic environment in which students and
faculty Discuss and analyze problems Share ideas Interact professionally
Funding W.M. Keck Foundation Three year implementation period
NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 3
Design of Assessment Plan
Formative assessment period Phases I - V Scheduled for completion by May 1, 2005
Summative assessment period Phase VI Scheduled for completion by January 1, 2006
Includes quantitative and qualitative assessment methodologies
NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 4
Phases I - II 1/1/03 - 8/15/03
Preparation of facility for use Design final layout Order furniture, hardware, and software Request electrical modifications (network drops)
Preliminary module development Course-based modules developed by project leaders
and used as a guide for other faculty Course-based modules and Unix tutorials developed by
affiliated faculty Development of assessment plan
Outline three year assessment plan Design survey instruments Obtain Institutional Review Board approval as needed
NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 5
Phase III 8/15/03 - 5/1/04
Implementation and revision of Phase II modules
Implementation of controlled access (Bear Cards)
Initial monitoring of facility usage ISE 327 (Statistical Process Control) Faculty Usage Matrix Student Usage Matrix
Initial collection of student satisfaction data
NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 6
Phase IV 5/1/04 - 8/15/04
Development of additional learning modules
Preparation for publication of Phase III modules
Preliminary analysis of assessment data Student Surveys Faculty Usage Matrix Student Usage Matrix Electronic Surveillance Reports
NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 7
Phase V 8/15/04 - 5/1/05 Implementation/revision of Phase IV
modules Collection of educational assessment data
EGR 232 XXX 487/488
Continued monitoring of controlled access ISE 327 (Statistical Process Control) Faculty Usage Matrix Student Usage Matrix Electronic Surveillance Reports
Continued assessment of module efficacy
NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 8
Phase VI 5/1/05-1/1/06 Final revision of all modules Web publication of modules Analysis of educational assessment data Analysis of student and faculty usage data Dissemination
Final Assessment Report to Keck Foundation Preparation of conference papers related to
module development and implementation Preparation of educational research journal
article related to EGR 232 study
NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 9
Initial Assessment Observations 1
Module development can be very time consuming
Module refinement must occur during academic year
Faculty-delivered modules somewhat evenly spaced throughout the term
Typical faculty use Keck Analysis Center for required class activities 2-3 times during the term
NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 10
Initial Assessment Observations 2
Student usage varies throughout term, with greater usage occurring during middle of term
Most student usage due to required course assignments
Use of Keck Analysis Center for senior design sporadic and heavily dependent on nature of design project
NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 11
Select Student Survey Results
88/116 students gave the Center a rating of 4 or 5 with 5 being “essential to engineering education”
70/116 felt more class time should be spent in the Center
67/116 students expressed a strong interest in using the Center for projects outside of course requirements
79/116 students expressed a strong interest in learning more about the analysis capabilities of the Center software
NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 12
Summary of Assessment Plan Components
Module development and implementation Biomedical Engineering Computer Engineering Mechanical Engineering Industrial Engineering
Student feedback Usage statistics Solicitation of Institutional Review Board approval Satisfaction surveys
Educational effectiveness Design of educational experiments Solicitation of Institutional Review Board approval Implementation in EGR 232 (Statics/Solid Mechanics)
Dissemination of assessment results
NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 13
Acknowledgements
W. M. Keck Foundation Student Participants
James Sipe, System Administration
Rebecca Quesenberry, Website Design
ISE 327 Students (Keck Center Usage Sampling Project)
Faculty Participants Joan Burtner Donald Ekong Sinjae Hyun Hodge Jenkins Jack Mahaney Ramachandran
Radharamanan John Reece Renee Rogge Loren Sumner
NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 14
Extra Slides
Keep in notebook to use if needed
NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 15
Contact Information
ASSESSMENT [email protected] Phone (478) 301- 4127 Fax (478) 301- 2331
LEARNING MODULES [email protected] Phone (478) 301- 5533 Fax (478) 301- 2331
NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 16
Planned Module Implementation Biomedical Engineering
Biomechanics Biofluids Basic Biotransport
Phenomenon Computer Engineering
Digital Design with VHDL Computer Networks
Industrial Engineering Manufacturing Processes Computer Assisted
Manufacturing Systems
Mechanical Engineering Finite Elements Fluid Mechanics Visualization and Graphics Engineering Analysis Solid Mechanics II Statics/Mechanics of
Materials Machine Design
NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 17
Hardware / Software Implementation 20 Sun Workstations , 1 PC, Projection Screen State-of-the-art engineering software
Networking Intranet Internet
Printers Black and white laser printer Color printer
CFX CATIA
ANSYS MathWorks
ProEngineer Process Engineer
OPNET QUEST
Cadence V5-Inspect
NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 18
Module Development Matrix Format
Subject Area Designer PreliminaryModule
Developed
Module Presented
Module Refined
Module Finalized
ME – 1
ME – 2
ISE – 1
CPE – 1
CPE – 2
BME – 1
BME – 2
Others(as needed)
NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 19
Fall 2003 Survey
Were you better motivated to work on course assignments that required use of the Keck Engineering Analysis Center facilities
compared to traditional textbook homework?
14
24
38
18
7
0
10
20
30
40
50
60
1 - much moremotivated
2 3 - equallymotivated
4 5 - much lessmotivated
Nu
mb
er o
f R
esp
on
ses
NEAB 10/20/04 Formative Assessment of a Computer-Aided Analysis Center Slide 20
Fall 2003 Survey
How valuable do you think the facilities of the Keck Engineering Analysis Center are in engineering education?
03
20
45 43
0
10
20
30
40
50
60
1 - not at allvaluable
2 3 4 5 - essential toengineeringeducation
Nu
mb
er
of
Resp
on
ses