Practice:
Evaluate your outcomes to show your program is making a difference
Key Action:
Define a unique treatment
TOOL: Selecting Comparison Schools
Purpose:
Use this table to assess whether a potential comparison school’s program elements (referred to by evaluators as its “treatment”) are different enough from your magnet program treatment to serve as an effective comparison group for a quasi-experimental evaluation. When you conduct a quasi-experimental evaluation, you should be able to clearly describe: • •
•
Instructions:
How the magnet program and prospective comparison school are similar in student demographics and prior achievement The “unique treatment” (key program elements) that your magnet program offers, including who received it, who delivered it, and at what cost How this unique treatment is different from the comparison school’s treatment
1. Use the table to determine the extent to which potential comparison schools have a similar treatment to the magnet program you are trying to evaluate. 2. Eliminate comparison school candidates if there are a significant number of overlapping treatment elements (4 or more). If you cannot confidently assess how different a school’s program elements are from the magnet school’s, you may need to collect additional information about the school.
1
Practice:
Evaluate your outcomes to show your program is making a difference
Key Action:
Define a unique treatment
Checklist for Evaluating Prospective Comparison Schools
Treatment
Comparison school: _______________________ Treatment Treatment similar to different from magnet magnet
Comparison school: _______________________ Treatment Treatment similar to different from magnet magnet
Comparison school: _______________________ Treatment Treatment similar to different from magnet magnet
Program content (e.g., science) Instructional approach (e.g., inquiry) Brand or type of curriculum materials Curriculum integration; content areas integrated Time students spend on content Professional development for teachers and administrators Specific content of professional development (e.g., curriculum content, multicultural approaches) Recruitment activities Target population for recruitment (e.g., age, prior achievement levels, other relevant characteristics) 2