77
October 24 - 30 2005 CES/AEA Conference 1 Taking AIM: Demonstration Statewide Web-Based Planning, Reporting & Evaluation System AIMS Copyright 2002 – 2005 University of Arkansas Cooperative Extension Service

Aim demo

Embed Size (px)

DESCRIPTION

uuu

Citation preview

Page 1: Aim demo

October 24 - 30 2005 CES/AEA Conference 1

Taking AIM:

Demonstration

Statewide Web-Based Planning, Reporting & Evaluation System

AIMS Copyright 2002 – 2005 University of Arkansas Cooperative Extension Service

Page 2: Aim demo

October 24 - 30 2005 CES/AEA Conference 2

Taking AIM:

Presenters•Dr. Karen Ballard, Extension Evaluation Specialist

•Mrs. Nina Boston, Director of Information Technology

•Mr. Steve Hall, Computer Specialist

•Mrs. Mary Poling, AIMS Support Manager

Page 3: Aim demo

October 24 - 30 2005 CES/AEA Conference 3

Taking AIM:

Administrative Vision for AIMS:

• Web-based planning, reporting and evaluation system

• Consolidation of most reporting requirements

• Capacity for on-demand data extraction

Page 4: Aim demo

October 24 - 30 2005 CES/AEA Conference 4

Taking AIM:

Evaluation is the link between what we PROVIDE & what we EXPECT . . .

Data can answer:

Are we doing the RIGHT things &

WHAT are the RIGHT things?

Page 5: Aim demo

October 24 - 30 2005 CES/AEA Conference 5

Taking AIM:

Planning -Program POW

-Individual IPOW

Scheduling -Methods & Events

Reporting -Scheduled Events

-General Program Data

-Benchmark Indicators

Evaluation -Inputs & Outputs

-Benchmark & Impact Reports

Page 6: Aim demo

October 24 - 30 2005 CES/AEA Conference 6

Taking AIM:

Value of the Logic Model for AIMS

• Shows the “chain of events”

• Summarizes the key elements of the program

• Clarifies differences between activities & outcomes

• Signals “what to evaluate”

• Builds consensus around what the program is

Page 7: Aim demo

October 24 - 30 2005 CES/AEA Conference 7

Taking AIM:

Logic Model: AIMS Design Components:

Program

Investments

-Staff time

-Curricula

-Volunteers

-Salary Costs

Activities

(Methods)

-Products

-Classes

-Training

-Mailings

-Articles

- Participation

LEARNING

-Knowledge

-Awareness

-Skills

-Opinions

-Attitudes

ACTION

-Behavior

-Decisions

-Practice

IMPACT

Ultimate

Benefit =

-Economic

-Policy

-Social

-Environ.

-Health

Page 8: Aim demo

October 24 - 30 2005 CES/AEA Conference 8

Challenges:

1. Development Time Line 2. Complexity of Organization3. Inconsistent Terminology & Definitions4. Development Team Staffing Resources5. Attitudes of end users6. County computers7. User time required to learn the system8. Enhancements that will need to be made

Taking AIM:

Page 9: Aim demo

October 24 - 30 2005 CES/AEA Conference 9

Taking AIM:

System Features:

•Individualized plan of work formatted for all Extension programs

•Ability to develop IPOW for any “other” programs

•Scheduled programs automatically posted to Groupwise

Page 10: Aim demo

October 24 - 30 2005 CES/AEA Conference 10

Taking AIM:

System Features:

•Collection of data on development time, direct & indirect contacts

•Viewable itinerary

•Proxy Access

•Reports can be pulled by end-user as needed

Page 11: Aim demo

October 24 - 30 2005 CES/AEA Conference 11

Taking AIM:

Evaluation System Capacity:

•Management reports for supervisors

•Ability to view reports by employee, county, district, statewide, or program by month, quarter, and/or year

•Real time access to process evaluation data

Page 12: Aim demo

October 24 - 30 2005 CES/AEA Conference 12

Taking AIM:

Nina Boston

Director of Information Technology

Page 13: Aim demo

October 24 - 30 2005 CES/AEA Conference 13

Taking AIM:

Driving Principles•Provide one source for all reporting

•Centralize data management

•Roll out updates more uniformly

Page 14: Aim demo

October 24 - 30 2005 CES/AEA Conference 14

The previous model was standalone,

linear and inflexible.

Page 15: Aim demo

October 24 - 30 2005 CES/AEA Conference 15

A separate program captured civil rights data.

Page 16: Aim demo

October 24 - 30 2005 CES/AEA Conference 16

Taking AIM:

Past Reporting Was Dis

Before AIMS, narrative success stories were e-mailed at the end of the year instead of when they occurred.

jointed

Page 17: Aim demo

October 24 - 30 2005 CES/AEA Conference 17

Taking AIM:

What did we do right?User support was put at the top

Faculty and staff were at the table together

We began with outputs needed and worked backwards

After rollout, the programmer received only technical calls

Page 18: Aim demo

October 24 - 30 2005 CES/AEA Conference 18

Taking AIM:

What did we do wrong?AIMS was rolled out in 80 days with no pilot testing

The DEMO web was a late arrival

Checkboxes would have eased benchmark selection

User support team was hired after rollout, not before

Page 19: Aim demo

October 24 - 30 2005 CES/AEA Conference 19

Taking AIM:

Special Features Faculty are e-mailed each month with entry reminders

When events are planned, appointments post to thefaculty member’s GroupWise calendar

Development team access DEMO directly from AIMS

Reports are dynamically generated for independentretrieval of data

Page 20: Aim demo

October 24 - 30 2005 CES/AEA Conference 20

Taking AIM:

Growing Pains•Initial home was a production server holding many

other web applications

•The AIMS monthly entry deadline sent traffic soaring

•Constant changes to AIMS the first year affected thestability of the production server

•A dedicated server was purchased in August 2003

Page 21: Aim demo

October 24 - 30 2005 CES/AEA Conference 21

Taking AIM:

AIMS required behavioral changeThe basic computer skills of faculty were overestimated

[Prior to AIMS, some agents had secretaries print their e-mails and send all responses]

Secretaries previously entered data for agents

Reporting was required at least monthly

Page 22: Aim demo

October 24 - 30 2005 CES/AEA Conference 22

Taking AIM:

The Future•Professional Development module integrates with

AIMS, our accounting and training systems

•Platform moving to Oracle

•Centra Symposium, Educator and NetworkStreaming are tools to educate and support users

Page 23: Aim demo

October 24 - 30 2005 CES/AEA Conference 23

Taking AIM:

Specifications•Software

Microsoft Visual Interdev 6.0 Visual FoxPro 6.0

•HardwareGateway 960 Series, dual 2.4GHz

processors2GB memory36GB SCSI hard driveDDS-4 tape drive

AIMS Copyright 2002 – 2005 University of Arkansas Cooperative Extension Service

Page 24: Aim demo

October 24 - 30 2005 CES/AEA Conference 24

Taking AIM:

Mrs. Mary Poling

AIMS Support Manager

Page 25: Aim demo

October 24 - 30 2005 CES/AEA Conference 25

Taking AIM:

Shooting for the Bullseye:Planning

Scheduling

Reporting

Results

Page 26: Aim demo

October 24 - 30 2005 CES/AEA Conference 26

Taking AIM:

Creating Plan of Work

Page 27: Aim demo

October 24 - 30 2005 CES/AEA Conference 27

Select Food Stamp Nutrition Education (FSNE)

Page 28: Aim demo

October 24 - 30 2005 CES/AEA Conference 28

Select Goal

Page 29: Aim demo

October 24 - 30 2005 CES/AEA Conference 29

Staff Days

Page 30: Aim demo

October 24 - 30 2005 CES/AEA Conference 30

Page 31: Aim demo

October 24 - 30 2005 CES/AEA Conference 31

Preview IPOW prior tonotifying supervisor

Page 32: Aim demo

October 24 - 30 2005 CES/AEA Conference 32

Taking AIM:

Scheduling & Reporting

Page 33: Aim demo

October 24 - 30 2005 CES/AEA Conference 33

Scheduling & Reporting Events

Page 34: Aim demo

October 24 - 30 2005 CES/AEA Conference 34

Page 35: Aim demo

October 24 - 30 2005 CES/AEA Conference 35

Page 36: Aim demo

October 24 - 30 2005 CES/AEA Conference 36

Select School to Report

Page 37: Aim demo

October 24 - 30 2005 CES/AEA Conference 37

Page 38: Aim demo

October 24 - 30 2005 CES/AEA Conference 38

Page 39: Aim demo

October 24 - 30 2005 CES/AEA Conference 39

Select Teachers

Page 40: Aim demo

October 24 - 30 2005 CES/AEA Conference 40

Page 41: Aim demo

October 24 - 30 2005 CES/AEA Conference 41

Page 42: Aim demo

October 24 - 30 2005 CES/AEA Conference 42

Page 43: Aim demo

October 24 - 30 2005 CES/AEA Conference 43

Page 44: Aim demo

October 24 - 30 2005 CES/AEA Conference 44

Page 45: Aim demo

October 24 - 30 2005 CES/AEA Conference 45

Taking AIM:

Retrieving Results

Page 46: Aim demo

October 24 - 30 2005 CES/AEA Conference 46

Select Program Results

Page 47: Aim demo

October 24 - 30 2005 CES/AEA Conference 47

Page 48: Aim demo

October 24 - 30 2005 CES/AEA Conference 48

Page 49: Aim demo

October 24 - 30 2005 CES/AEA Conference 49

Page 50: Aim demo

October 24 - 30 2005 CES/AEA Conference 50

Page 51: Aim demo

October 24 - 30 2005 CES/AEA Conference 51

Page 52: Aim demo

October 24 - 30 2005 CES/AEA Conference 52

Page 53: Aim demo

October 24 - 30 2005 CES/AEA Conference 53

Page 54: Aim demo

October 24 - 30 2005 CES/AEA Conference 54

Page 55: Aim demo

October 24 - 30 2005 CES/AEA Conference 55

Page 56: Aim demo

October 24 - 30 2005 CES/AEA Conference 56

Page 57: Aim demo

October 24 - 30 2005 CES/AEA Conference 57

Page 58: Aim demo

October 24 - 30 2005 CES/AEA Conference 58

Detail Report by Individual or Unit Name

Page 59: Aim demo

October 24 - 30 2005 CES/AEA Conference 59

Unit Summary Report

Page 60: Aim demo

October 24 - 30 2005 CES/AEA Conference 60

Page 61: Aim demo

October 24 - 30 2005 CES/AEA Conference 61

Page 62: Aim demo

October 24 - 30 2005 CES/AEA Conference 62

Page 63: Aim demo

October 24 - 30 2005 CES/AEA Conference 63

Page 64: Aim demo

October 24 - 30 2005 CES/AEA Conference 64

Page 65: Aim demo

October 24 - 30 2005 CES/AEA Conference 65

Taking AIM:

Reporting Impacts

Page 66: Aim demo

October 24 - 30 2005 CES/AEA Conference 66

Page 67: Aim demo

October 24 - 30 2005 CES/AEA Conference 67

Page 68: Aim demo

October 24 - 30 2005 CES/AEA Conference 68

Page 69: Aim demo

October 24 - 30 2005 CES/AEA Conference 69

Page 70: Aim demo

October 24 - 30 2005 CES/AEA Conference 70

Page 71: Aim demo

October 24 - 30 2005 CES/AEA Conference 71

Page 72: Aim demo

October 24 - 30 2005 CES/AEA Conference 72

Page 73: Aim demo

October 24 - 30 2005 CES/AEA Conference 73

Taking AIM:

Page 74: Aim demo

October 24 - 30 2005 CES/AEA Conference 74

Page 75: Aim demo

October 24 - 30 2005 CES/AEA Conference 75

Taking AIM:

Page 76: Aim demo

October 24 - 30 2005 CES/AEA Conference 76

Page 77: Aim demo

October 24 - 30 2005 CES/AEA Conference 77

Taking AIM:

Questions?