Diplomas Now Validation Study

Diplomas Now Validation Study:Case Study ThemesAshley Briggs, Ed.D., case study leadFelix Fernandez, Ph.D, implementation leadICF International

1July 8, 20151Session ObjectivesParticipants willDevelop a general understanding of the Diplomas Now evaluation and the case study design;Discover details related to three key themes:Importance of role clarityPractices to build schools understanding of Diplomas NowStrategies to increase support from school staffSituate these themes in their own experiences; and

2

2Introduction Activity33Activity DirectionsEach person at the tableIntroduce yourself (name, school, and role).Read the quote placed in front of you aloud to the group.Briefly share what you would like to learn from the session based on the quote or the learning objectives.

4

4

The Diplomas Now Validation Study

55

Validation Study OverviewU.S. Department of Education Investing in Innovation (i3) grant to Johns Hopkins UniversityPurpose: Validate the impact of a school turnaround model in increasing student graduation ratesIndependent evaluation to assess impact and fidelity of implementationResearch partnership with MDRC and ICF International

66Evaluation DesignSchool level randomized controlled trial study (RCT)Analyze data to look for differences in student outcomesSchool recordsStudent surveysImplementation studyAssess fidelity of implementation (inputs and outputs)Program staff surveysTeacher surveysIdentify promising practicesCase studies at select DN schools

7

7Case Study Research Questions1.How is DN implemented across case study schools? 2. What factors facilitated and/or hindered implementation of the DN model? 3.What are the perceived benefits of the DN model across case study schools? 4.What were the drawbacks, if any, to implementing the DN model? 5.What lessons can be learned from the implementation of DN across case study schools?

8

8Case Study SitesYear 14 HS3 MS4 districtsYear 25 HS4 MSSame 4 districts9

9Data Collection MethodsInterviewsFocus groupsObservationsclassroom activitiescollaborative planning meetingsEWI meetingsbefore/after school activities

10

10Case Study Participant GroupsFocus Groups (2 groups of 10-12 each)Parents Students Teachers CY Corp Members

11Interviews (district-based staff)Instructional facilitatorDN field managerDN IST representativeS4 facilitator2-3 District leaders

Interviews (school-based staff)School Transformation FacilitatorCY Program ManagerCY team leadsCIS Coordinator School administratorsSchool counselorsInstructional coaches

11Lessons Learned About Implementing Diplomas Now12Relationships are everything. If you dont have those relationships, then you will meet lots of resistance.12Role ClarityEstablishing clearly defined roles promotes cohesion within the Diplomas Now team.Securing staff early enables collaborative planning based on common goals. Shared office space helps to create natural opportunities for continuous check-ins. 13Everyone knew what the next person was doing, and so it kept things seamless.-AdministratorWe have teamwork, transparency, and trust.-Field Manager13Role Clarity (Cont.)Accountability among staff members is useful to clarify responsibilities across each organization while working collectively. Diplomas Now staff turnover can create challenges and opportunities. 14Were separate entities but really when were in the school, we have to move and act as one.-CIS Site CoordinatorSomething thats been huge is we have two team leaders that are returning... And me being a new program manager, the first three months here I still had to figure out whos who and whats what, and theyve been a tremendous help in kind of that process. -City Year Program Manager14School Staff Understanding of DNTrainings/forums to explain DN and show available resources/supportsCity Year AmeriCorp members as a highly visible program componentClarity about DN as a way to set realistic expectations

15The leadership expected Diplomas Now to come in and save the day overnight, not understanding that it takes time.-School Transformation FacilitatorI really wanted to make sure that I was supporting teachers in the beginning and making sure that I was a resource for them.-School Transformation Facilitator15Flexibility to Garner SupportActive administrator support that reinforces teacher engagementRemaining flexible and sensitive to school context

16Youve got to take each school where it is.-School and Students Support Services FacilitatorIf you have outside programs in your building, you cannot isolate them. Its important that you incorporate them into the fabric of the building. And it was important that I incorporate Diplomas Now into my leadership team.-Administrator16Flexibility to Garner Support (cont.)Enthusiasm for DN builds as school staff start to see desired changeAlignment to school goals allowing DN to be embedded in schools

17Administration was sure to point out that they were skeptical at first, but they are very pleasantly surprised at the impact that we had this year.-City Year Program ManagerYoure more successful when you say, Im here to accelerate your vision but were going to do it a little differently.-Field Manager17SummaryAlone we can do so little, together we can do so much.1818Full ReportsMoving Down the Track: Changing School Practices During the Second Year of Diplomas Now. http://www.mdrc.org/publication/moving-down-trackLaying Tracks to Graduation: The First Year of Implementing Diplomas Now. http://www.mdrc.org/publication/laying-tracks-graduation.

1919Questions or Concerns?2020