1
Academic Support Grantee Academic Support Grantee Data TrainingData Training
Department of Education
Hoagland-Pincus Center (UMass)
Shrewsbury, MA
January 13, 2005
2
FY04 School Year ProgramsFY04 School Year Programs Highlights (all fund codes) Highlights (all fund codes)
248 districts, high schools, community colleges, and partnering organizations served 8,653 students in the classes of 2003-2006.
Participating students each received an average of 27.3 hours of MCAS remediation service.
4,234 of the students served earned their competency determination (CD) after participation in the program.
24% more students participating in AS programs earned their CD compared to those not participating in AS programs (60% compared to 36%).
3
A) FY04 School Year Programs - Percentage of Participants by Original Class Year
Seniors (Class of '04)
24%
Previous Year's Seniors
(Class of '03)3%
Sophomores (Class of '06)
17%
Juniors (Class of '05)
56%Note: Eligible classes vary program to program.
4
FY04 School Year Programs -FY04 School Year Programs -Highlights (all fund codes)Highlights (all fund codes)
58% of programs took place during the school day, 37% during extended time (before or after-school/evening),
5% during the weekend.
70% of programs focused on mathematics; 30% on English language arts.
18% of students served were from vocational schools.
50% of participating students received individual (1 teacher:1 student) or smallest group instruction (1:2-5),
45% received small group instruction (1:6-10), and 5% received an “other” type of instructional model.
5
B) Pre/Post MCAS Averages by Subject
212
214
216
218
220
222
224
ELA MTH
Subject
MC
AS
Ave
rag
e
Pre
Post
+4.9 +7.4
Passing
6
C) Pre/Post MCAS Averages by Fund Code
212
214
216
218
220
222
224
596 598 619 632
Fund Code
Pre
Post
+6.8 +3.6 +4.9 +6.9
Work & Learning Community Colleges Districts/ Partners - Competitive Districts - Allocation
7
D) Pre/Post MCAS Averages by Instructional Model
212
217
222
227
1:1 1:2-1:5 1:6-1:10 Other
Instructional Model(Teacher to Student Ratio)
MC
AS
Ave
rage
Pre
Post
+7.8 +7.4 +6.1 +5.6
Passing
8
E) Pre/Post MCAS Averages by Hours of Service
212
214
216
218
220
222
224
1-10 11-20 21-30 31-40 41-50 50+
Average Hours of Service per Student
MC
AS
Ave
rage
Pre
Post
+7.0 +6.8 +6.3 +5.3 +4.8 +6.5
9
F) Pre/Post MCAS Averages by Project Type
212
214
216
218
220
222
224
School Day Extended Day Weekend
Project
MC
AS
Ave
rage
Pre
Post
+6.0 +6.5 +6.5
10
Included in reports for legislature and Board of Ed. Viewed as a reflection of program effectiveness Influences TA provided to grantees Considered when determining funding amts. for
grant programs and individual grants Cost per pupil #’s served Completion rates Gains made on MCAS tests Dosage effect (effect of increased participation hrs.)
How Department Uses How Department Uses Academic Support Data?Academic Support Data?
11
What Type of Data is What Type of Data is Collected/Selected?Collected/Selected?
SASID Student Name, Grade, School Fund Code (School Year / Summer)
Allocation Grants632/625 – Districts/Approved SPED Schools
Competitive Grants596/597 – Work and Learning Programs598/593 – Community Colleges/Partners 619/592 – Districts/Partners
12
What Type of Data is What Type of Data is Collected/Selected?Collected/Selected?
Project Info. (e.g. ELA3D – HS English during day)
Content Area Grade
Levels
Schedule Type
MTH - Math 3 - HS D – During
ELA – English Lang. Arts
8 - Vocational E - Extended
9 – SPED Placement
T - Weekend
0 – 9th/10th S – Summer Vacation
13
What Type of Data is What Type of Data is Collected/Selected?Collected/Selected?
Instructional Model (Teacher:Student)1:1 (Individual)1:2-5 (Smallest Group)1:6-10 (Small Group)Other (*Note: Must explain in narrative evaluation)
Hours of Service per Student Pre/Post MCAS Scores (*Note: Entered by Department)
14
What Type of Data is What Type of Data is Collected/Selected?Collected/Selected?
Student Status– Completed Program:
Participated in at least 75% of possible hours of service
– Withdrew: Participated in fewer than 75% of possible hours of service
– Enrolled, but did not attend: Initially enrolled; zero hours of service
– Participated until receipt of 220+ score: Attended program until s/he learned (during the program) that s/he passed the most recent MCAS test; hours of service > zero
– Transferred out of school/district: Student was enrolled and may have attended, but s/he did not complete program due to transferring out of the school/district.
15
How to Use Data?How to Use Data?
Inform narrative evaluations and future proposals Improve your program
Do we need to increase outreach efforts? Is Day vs. Extended better for attendance and outcomes? Are more service hours correlated to greater MCAS gains? Was there more success with ELA vs. MTH – why? What was the most important factor for MCAS score gains?
Build support for your program
(e.g. present data to school board or to other potential funders)
16
How to Improve Data How to Improve Data Collection?Collection?
Appoint central person to plan collection and input data into security portal.
Make sure central person has access to security portal and is aware of deadlines.
Have central person share with program instructors the data that needs to be collected, their role in the collection process, and why it is collected.
17
How to Improve Data How to Improve Data Collection?Collection?
Suggestions:
Maintain data in an excel spreadsheet before inputting into the security portal. (http://www.doe.mass.edu/as/data/as_template.xls)
Start entering data into security portal at least two weeks before due date to account for issues that may arise and so that it can be used to inform your narrative. (http://www4.doemass.org)
18
When are theWhen are theData Submission Due Dates?Data Submission Due Dates?
Session Times: Data Due Dates
Fall (Sept. to mid-Nov).: 1/31/05 *Winter (Late-Nov. to early-Mar.): 4/30/05Spring (Feb/Mar. to May/June): 7/31/05 **Summer (July to August): 9/30/05 **
* Mid-year narrative evaluation & data reports due for fund code 598.
** Narrative evaluations due for all fund codes (& for FC598/593 data report).
19
20
21
22
23
24
25
26
27
28
29
Questions?
Contact Allison Ward,Academic Support Data Specialist
Tel: 781-338-3232
Email: [email protected]
Website: http://www.doe.mass.edu/as/data