Ethics-IRB Protection of Human Subjects All school leaders participating in the proposed study were protected in conjunction with Institutional Review Board (IRB) guidelines from Teachers College. All participants were informed via e-mail and snail mail of the nature of the research and the amount of time and effort asked from them (Appendix C-1).
• All participants were informed via the informed consent form of how their anonymity will be protected. This included plans for ensuring confidentiality of data by the creation of a coding system for all schools and corresponding school leaders.
Ethics and Data Handling • All subjects were given pseudonyms for computer input and data processing. The only people with access to this information will be the dissertation committee at Teachers College, Columbia University. All taped interviews were coded by school, leader, and date. All tapes were transcribed; hard copy transcriptions were locked in a file cabinet in the researcher’s home. All tapes will be destroyed.
Ethics and Data Handling • At the time of interview, all participants signed a consent form indicating their understanding of the research process. Participants were told that they may discontinue participation at any time, by indicating to the interviewer to stop the interview. They were allowed to answer a question “off the record” in order to help them feel more comfortable to continue.
Surveys • Advantages – High Reliability if standardized – Used for descriptive data collection – Used for large scale collection
Surveys • Disadvantages – Serious threats to internal and external validity – Return rates vary – Time commitment in design and analysis
Surveys • Hints – Used almost exclusively in quantitative studies. – Be focused on what kind of information you want to collect. Backwards design.
Samples • Random-completely selected by chance (lottery) must be tightly structured! • Stratified Random-splitting a sample population and then randomly sampling from within
Samples • Hints – Sampling involves decision not only about which people to observe or interview, but also about settings, events and social processes. – Sampling means taking a smaller chunk of a larger universe. – A good conceptual framework will help set the foci and boundaries for sampling decisions. – The main goal of sampling is to strengthen the conceptual validity of the study.
Samples • Hints – Always state how and why you chose your sample. Be honest! – Don’t sample too narrowly. – Time is big factor; sampling cases in a multiple-case study is a very demanding experience. Know your boundaries.
Interviews • Advantages – Collecting “Rich” data – Observing behavior – Non-verbal clues – Ability to modify Questions
Interviews • Disadvantages – Time consuming – Changing questions threatens reliability – Accessibility – Cost effectiveness – May be hostile – Serious threats to reliability and validity
Interviews • Structured • Semi-Structure (Open Ended)
Interviews • Hints – If taping, have extra batteries and tapes – If taping, test distance from microphone – Always ask permission to tape – Listen-the temptation is to speak but don’t! – Warm up with easy questions, get the respondent talking and comfortable with you. – You get better with practice (pilot)
Questionnaires • Advantages – Time – Money – Larger sampling population – More information
Questionnaires • Disadvantages – Response rates – Threats to validity (how do you know if was completed properly) – No visual clues
Questionnaires • Hints – Keep questions closed. Data will be all over the place otherwise. – Keep responses simple, don’t confuse the respondent.